-- Logs begin at Tue 2022-05-31 13:52:06 UTC, end at Tue 2022-05-31 15:31:55 UTC. -- May 31 14:29:43.901341 dv-cinder-839793-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 14:29:43.914405 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 14:29:43 2022] *** May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: nodename: dv-cinder-839793-14-iscsi May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: machine: x86_64 May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: clock source: unix May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: pcre jit disabled May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: detected number of CPU cores: 4 May 31 14:29:43.916459 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: current working directory: / May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: detected binary path: /usr/bin/uwsgi-core May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: your processes number limit is 47680 May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: your memory page size is 4096 bytes May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: detected max file descriptor number: 2048 May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: lock engine: pthread robust mutexes May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: thunder lock: enabled May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 14:29:43.917078 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 14:29:43.961301 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: Python main interpreter initialized at 0x555b8692f9c0 May 31 14:29:43.961301 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: python threads support enabled May 31 14:29:43.961301 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: your server socket listen backlog is limited to 100 connections May 31 14:29:43.961301 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: your mercy for graceful operations on workers is 90 seconds May 31 14:29:43.961636 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: mapped 403077 bytes (393 KB) for 2 cores May 31 14:29:43.961712 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: *** Operational MODE: preforking *** May 31 14:29:43.961957 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: *** uWSGI is running in multiple interpreter mode *** May 31 14:29:43.961957 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: spawned uWSGI master process (pid: 103329) May 31 14:29:43.962130 dv-cinder-839793-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 14:29:43.962783 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: spawned uWSGI worker 1 (pid: 103330, cores: 1) May 31 14:29:43.963113 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: spawned uWSGI worker 2 (pid: 103331, cores: 1) May 31 14:29:43.963283 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 14:29:45.181041 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 14:29:45.199523 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 14:29:45.899376 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:29:45.899376 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 31 14:29:45.900473 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:29:45.900473 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 31 14:29:45.904339 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:29:45.904339 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes May 31 14:29:45.904682 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:29:45.904682 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes May 31 14:29:48.514878 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:29:48.515392 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:29:48.515565 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:29:48.515932 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:29:48.516191 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:29:48.517180 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.517452 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:29:48.517855 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.517947 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:29:48.518027 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.518141 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.518242 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:29:48.518476 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.518594 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:29:48.518816 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.518918 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:29:48.519141 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.519239 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.519463 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.519574 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.519794 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.519888 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520057 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520209 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520374 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520545 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520703 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-14-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.520863 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521029 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521189 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521347 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521512 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521661 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521834 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.521983 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.522079 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.522290 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.522390 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.522616 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.522735 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-14-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.523019 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.523164 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.523359 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.523521 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.523932 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524061 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524168 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524283 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524396 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524552 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524682 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.524888 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525000 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525206 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525395 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525503 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525712 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.525827 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526023 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526139 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526342 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526466 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526700 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.526837 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527022 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527190 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-14-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527337 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527512 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527723 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527830 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.527981 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.528132 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.528309 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.528548 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.528647 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.528862 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-14-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529173 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529328 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529498 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529636 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529825 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.529950 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.530134 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.530368 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.530455 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.530701 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.530805 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531018 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531105 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531344 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531432 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531671 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531756 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.531984 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532072 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532341 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532431 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532663 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532766 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.532972 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533068 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533279 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533374 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533532 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533626 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533842 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.533938 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534169 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534257 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534493 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534579 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534830 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.534971 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535089 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535176 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535341 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535432 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535663 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535764 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.535987 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536082 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536301 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536389 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536611 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536698 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536875 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.536961 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537131 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537227 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537456 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537543 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537794 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.537920 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538099 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538204 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538407 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538509 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538740 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.538845 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539053 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539156 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539364 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539535 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539673 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.539981 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540174 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540290 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540579 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540705 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540836 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.540944 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541147 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541235 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541496 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541583 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541819 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.541915 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542128 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542215 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542449 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542542 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542789 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.542892 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543105 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543190 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543414 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543510 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543723 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.543810 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544046 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544133 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544369 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544468 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544675 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544762 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.544927 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545015 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545232 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545320 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545538 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545626 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545859 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.545949 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546168 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546260 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546436 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546529 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546765 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.546868 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547077 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547164 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547383 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547470 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547691 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.547784 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548072 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548242 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548385 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548472 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548690 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548783 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.548994 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549089 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549303 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549399 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549610 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549695 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.549917 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550011 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550227 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550313 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550535 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550629 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550870 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.550970 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551174 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551266 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551481 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551573 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551787 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.551882 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552109 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552201 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552416 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552509 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552724 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.552819 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553034 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553123 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553339 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553425 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553645 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553740 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.553959 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554044 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554263 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554349 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554574 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554727 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.554908 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555003 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555221 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555321 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555530 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555663 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555837 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.555924 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556150 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556244 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556461 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556557 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556767 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.556852 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557072 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557166 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557379 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557475 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557687 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557779 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.557992 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558123 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558298 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558393 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558603 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558708 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.558936 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559040 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559247 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559342 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559556 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559650 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559863 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.559962 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560168 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560253 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560577 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560816 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.560912 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.561129 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.561215 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.561439 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.561534 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.561749 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.561846 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.562073 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:29:48.562160 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.562409 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.562497 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.562757 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.562858 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.563075 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.563162 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.563987 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564089 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564249 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564346 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564565 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564653 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564879 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.564966 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565195 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565290 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565515 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565614 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565834 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.565934 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566167 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566255 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566485 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566570 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566825 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.566924 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567148 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567236 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567463 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567550 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567782 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.567870 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568110 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568241 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568432 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568526 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568745 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.568846 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569059 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569145 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569379 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569465 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569712 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.569876 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.570038 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.570132 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.570615 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.570749 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.570953 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571049 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571267 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571355 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571583 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571673 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.571906 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572004 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572242 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572330 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572555 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572641 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572870 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.572958 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573180 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573267 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573492 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573581 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573802 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.573890 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574112 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574199 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574424 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574511 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574772 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.574862 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575090 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575176 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575402 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575489 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575713 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.575840 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576026 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576114 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576337 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576432 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576649 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576736 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.576960 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577047 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577267 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577362 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577572 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577665 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577878 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.577966 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578191 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578337 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578498 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578593 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578831 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.578930 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.579704 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.579813 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580024 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580121 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580342 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580429 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580683 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.580788 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581010 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581107 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581327 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581422 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581641 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581729 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.581951 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582037 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582265 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582351 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582578 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582684 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.582913 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583012 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583226 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583312 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583536 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583624 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583842 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.583929 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584155 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584241 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584465 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584553 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.584873 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585090 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585186 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585398 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585484 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585707 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.585794 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586020 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586117 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586329 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586415 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586691 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586794 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.586987 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587087 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587299 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587386 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587620 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587715 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.587937 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588244 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588329 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588569 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588654 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588885 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.588972 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589203 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589295 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589511 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589598 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589823 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.589923 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590129 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590217 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590437 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590524 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590767 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.590871 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591081 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591216 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591393 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591481 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591699 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.591797 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592006 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592094 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592313 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592409 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592619 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592706 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.592945 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593032 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593251 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593347 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593552 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593638 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593856 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.593949 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594159 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594255 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594484 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594570 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594843 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.594932 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595153 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595255 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595462 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595550 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595768 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.595855 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596116 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596204 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596425 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596514 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596740 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.596827 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597053 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597141 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597366 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597453 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597779 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.597992 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598080 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598314 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598401 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598627 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598735 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.598969 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599064 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599278 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599364 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599591 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599756 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599903 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.599990 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600215 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600301 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600520 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600621 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600837 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.600925 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601163 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601288 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601477 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601574 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601799 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.601887 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602109 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602197 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602420 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602520 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602767 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.602870 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603081 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603168 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603394 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603484 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603703 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.603798 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604015 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604102 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604332 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604429 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604640 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604728 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.604953 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605040 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605268 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605363 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605581 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605676 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605904 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.605992 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606216 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606312 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606537 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606626 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606872 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.606963 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607199 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607286 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607509 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607595 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607833 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.607936 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608145 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608239 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608455 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608551 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608764 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.608864 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609074 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609162 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609386 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609485 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609694 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.609791 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.610002 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.610090 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.610851 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.610947 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611172 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611270 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611485 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611576 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611793 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.611926 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612102 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612189 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612413 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612499 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.612817 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613029 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613126 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613333 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613428 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613639 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613733 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.613960 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614055 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614270 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614356 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614577 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614711 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.614918 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615008 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615225 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615313 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615531 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615626 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615854 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.615942 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616166 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616297 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616471 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616568 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616777 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.616871 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617081 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617178 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617406 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617502 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617720 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.617814 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618023 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618109 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618338 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618433 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618725 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618828 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.618982 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619077 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619297 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619392 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619608 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619696 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.619917 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620004 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620240 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620327 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620552 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620638 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620862 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.620949 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621174 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621263 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621484 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621571 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621801 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.621887 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622109 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622197 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622421 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622508 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622752 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.622854 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623063 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623151 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623372 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623460 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623677 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623774 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.623986 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624080 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624300 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624387 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624614 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624868 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.624964 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625207 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625294 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625521 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625606 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625842 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.625995 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.626740 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.626985 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627327 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627416 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627650 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627748 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.627975 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628064 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628306 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628468 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628631 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628727 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.628942 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629030 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629249 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629345 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629565 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629661 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629872 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.629969 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630180 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630274 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630487 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630575 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630830 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.630930 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631136 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631223 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631441 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631530 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631751 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.631838 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632059 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632153 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632375 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632476 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632776 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.632985 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633287 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633373 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633592 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633908 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.633994 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634214 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634301 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634518 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634604 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634849 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.634950 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635181 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635271 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635484 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635571 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635789 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.635886 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636100 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636187 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636407 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636501 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636754 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.636851 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637062 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637149 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637389 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637476 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637696 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.637785 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638002 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638100 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638308 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638396 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638619 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638768 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.638953 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639054 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639258 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639347 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639572 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639667 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639879 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.639965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640188 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640275 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640497 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640584 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640801 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.640887 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641107 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641203 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641412 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641519 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641749 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.641843 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642062 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642198 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642365 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642455 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642700 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.642792 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643001 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643100 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643308 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643394 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643614 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643704 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.643917 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644017 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644218 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644312 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644528 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644614 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644833 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.644920 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645137 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645223 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645440 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645534 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645742 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.645836 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646049 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646135 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646355 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646442 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646667 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646756 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.646987 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647074 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647295 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647381 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647601 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647690 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647906 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.647992 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648209 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648313 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648511 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648599 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648819 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.648905 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649136 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649234 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649448 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649544 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649751 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.649844 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650055 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650150 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650356 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650449 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650770 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.650989 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651088 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651296 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651384 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651599 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651686 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651908 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.651998 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652216 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652305 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652525 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652612 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652834 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.652923 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653138 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653225 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653443 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653530 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653748 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.653837 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654052 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654147 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654352 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654451 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654698 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.654788 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655008 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655162 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655312 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655408 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655619 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655706 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.655924 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656011 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656259 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656354 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656565 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656651 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656874 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.656962 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657219 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657321 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657526 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657614 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657840 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.657928 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658149 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658245 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658462 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658556 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658793 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.658895 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.659098 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.659195 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.659894 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.659894 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660117 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660224 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660345 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660528 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660644 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660854 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.660969 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.661185 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.661309 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.661507 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.661628 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.661834 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662009 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662162 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662322 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662537 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662872 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.662999 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663188 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663312 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663502 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663593 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663813 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.663901 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664127 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664216 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664441 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664527 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664754 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.664841 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665066 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665154 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665378 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665463 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665682 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665768 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.665992 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666079 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666300 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666388 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666604 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666705 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.666938 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667131 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667247 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667450 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667575 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667761 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.667888 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668202 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668381 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668514 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668693 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.668824 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669000 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669139 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669431 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669530 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669747 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.669870 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670060 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670188 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670369 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670501 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670704 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.670836 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671019 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671151 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671336 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671466 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671653 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671783 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.671968 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.672098 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.672389 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.672488 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.672703 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.673334 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.673531 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.673654 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.673843 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.673971 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674152 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674286 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674460 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674594 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674821 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.674925 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675151 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675240 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675461 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675549 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675768 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.675861 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676167 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676397 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676492 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676703 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.676792 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677028 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677154 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677353 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677438 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677747 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.677824 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678055 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678132 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678373 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678473 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678809 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.678900 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679125 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679202 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679437 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679522 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679760 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.679843 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680085 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680162 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680389 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680475 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680704 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.680796 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681015 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681093 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681327 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681402 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681656 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681749 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.681965 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682041 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682284 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682360 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682589 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682697 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682921 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.682997 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.683249 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.683333 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.683567 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.683652 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.683922 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684010 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684202 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684280 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684606 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684684 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684915 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.684992 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685239 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685324 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685563 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685640 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685866 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.685942 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686173 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686263 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686480 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686581 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686816 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.686918 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687120 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687207 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687431 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687530 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687737 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.687831 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.688048 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.688149 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.688379 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689064 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689227 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689315 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689533 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689631 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689839 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.689928 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690146 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690233 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690456 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690553 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690799 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.690929 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691114 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691227 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691433 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691560 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691750 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.691864 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692056 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692180 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692369 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692483 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692681 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692772 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.692986 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693075 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693289 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693384 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693590 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693677 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693893 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.693994 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694224 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694363 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694529 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694877 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.694992 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.695204 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.695578 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.695782 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.695896 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696104 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696226 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696429 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696550 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696746 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.696860 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697063 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697185 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697384 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697498 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697810 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.697987 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698111 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698296 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698412 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698600 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698713 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.698934 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699036 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699236 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699324 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699545 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699632 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699846 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.699934 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700149 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700236 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700452 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700552 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700755 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.700843 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701067 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701154 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701376 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701470 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701687 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701782 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.701994 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.702120 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.702313 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.702583 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.702823 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.702974 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703125 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703264 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703416 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703568 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703712 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.703850 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704018 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704321 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704532 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704688 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704830 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.704830 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705087 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705225 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705367 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705525 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705667 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705808 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.705959 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706113 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706253 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706405 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706542 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706748 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.706912 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707050 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707206 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707355 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707505 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707680 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.707823 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708002 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708155 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708310 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708450 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708621 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708766 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.708943 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.709197 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.709343 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.709526 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.709823 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.709967 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710148 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710293 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710464 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710610 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710854 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.710993 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711131 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711260 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711396 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711528 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711722 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.711863 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712030 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712128 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712344 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712431 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712660 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712757 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.712974 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713063 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713300 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713396 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713638 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713848 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.713963 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.714266 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.714444 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.714585 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.714916 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.715085 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.715274 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.715591 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.715679 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.715901 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.716219 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.716310 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.716538 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.716811 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.716907 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.717155 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.717389 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.717487 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.717770 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.718056 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.718200 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.718391 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.718685 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.718841 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719036 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719198 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719348 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719505 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719679 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719842 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.719998 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720137 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720321 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720424 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720637 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720735 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.720954 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721051 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721275 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721437 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721583 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721807 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.721964 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722126 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722285 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722435 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722584 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722787 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.722942 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723103 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723259 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723420 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723511 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723739 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.723827 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.724069 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.724328 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.724419 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.724675 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.724926 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.725072 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.725282 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.725588 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.725885 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.725974 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.726208 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.726485 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.726686 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.726845 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.727086 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.727175 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.727441 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.727672 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.727774 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728024 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728120 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728343 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728438 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728673 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.728771 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729001 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729256 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729344 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729617 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729827 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.729969 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.730188 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.730342 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.730501 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.730684 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.730855 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731006 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731153 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731311 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731460 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731617 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731779 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.731932 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732077 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732222 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732379 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732532 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732683 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.732927 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733017 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733231 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733322 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733561 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733713 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733852 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.733983 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.734173 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.734306 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.734475 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.734666 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.734856 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.735026 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.735153 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.735801 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.735955 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736086 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736214 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736344 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736512 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736621 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736833 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.736987 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737126 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737251 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737433 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737573 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737737 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.737866 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738048 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738178 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738354 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738495 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738723 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.738856 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739040 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739165 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739347 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739489 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739652 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739780 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.739960 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740089 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740269 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740421 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740578 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740704 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.740886 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741013 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741194 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741323 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741505 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741643 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741815 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.741943 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.742131 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.742261 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.742442 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.742699 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.742831 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743046 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743189 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743368 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743506 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743678 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743803 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.743993 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744137 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744318 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744445 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744627 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744754 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.744950 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745090 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745252 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745436 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745564 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745698 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745866 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.745995 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746179 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746308 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746489 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746640 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746856 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.746990 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.747126 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.747251 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.747423 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.747566 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.747734 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748000 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748202 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748344 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748485 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748670 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.748800 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749010 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749107 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749348 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749438 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749671 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749761 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.749984 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.750072 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.750297 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.750393 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.750627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.750737 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.751549 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.751686 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.751874 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.751977 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752189 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752279 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752503 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752591 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752821 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.752918 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753136 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753231 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753452 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753540 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753767 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.753863 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754084 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754173 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754388 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754475 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754723 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.754848 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755176 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755297 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755385 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755590 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755692 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.755915 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756004 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756228 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756318 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756555 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756652 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756879 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.756968 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.757194 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.757282 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.757533 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.757619 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.758237 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.758337 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.758429 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.758929 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759042 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759042 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759181 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759249 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759365 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759454 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759688 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.759776 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760006 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760124 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760323 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760443 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760637 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760771 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.760953 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.761099 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.761630 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.761737 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.761737 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762286 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762377 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762459 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762539 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762627 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762755 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.762931 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763032 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763245 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763334 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763558 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763647 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763871 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.763959 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.764181 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.764277 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.764495 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.764584 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765079 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765552 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765651 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765743 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765825 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765825 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.765970 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766091 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766179 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766400 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766507 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766760 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.766852 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767078 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767178 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767384 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767472 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767692 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.767779 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.768303 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.768410 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.768884 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.768975 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769057 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769057 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769202 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769281 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769351 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769496 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769804 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.769972 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770111 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770301 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770419 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770620 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770755 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.770974 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771063 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771291 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771379 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771619 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771707 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.771939 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772026 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772248 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772336 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772559 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772646 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772901 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.772990 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773218 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773304 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773532 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773619 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773847 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.773935 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774160 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774249 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774567 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774809 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.774898 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775140 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775227 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775460 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775564 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775781 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.775919 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776099 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776188 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776413 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776515 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776733 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.776828 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777048 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777136 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777360 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777448 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777673 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777768 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.777988 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778076 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778298 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778385 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778615 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778742 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.778952 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779052 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779265 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779392 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779581 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779677 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779899 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.779996 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780219 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780313 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780537 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780636 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.780946 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781177 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781264 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781585 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781811 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.781908 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782147 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782241 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782463 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782558 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782807 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.782916 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783129 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783218 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783456 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783543 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783765 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.783854 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.784010 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:29:48.784098 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.784398 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.784732 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.785085 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.785401 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.785749 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.786081 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.786400 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.786745 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.787059 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:29:48.787306 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:29:48.842955 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Registered counter for database nova_api May 31 14:29:48.846468 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Registered counter for database nova_api May 31 14:29:48.864802 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.866579 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.872352 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:48.873691 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:48.928696 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.context [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f(cell1) {{(pid=103330) load_cells /opt/stack/nova/nova/context.py:464}} May 31 14:29:48.929014 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.context [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f(cell1) {{(pid=103331) load_cells /opt/stack/nova/nova/context.py:464}} May 31 14:29:48.932846 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:29:48.933088 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:29:48.934404 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:29:48.934666 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:29:48.935216 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:29:48.935462 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:29:48.937172 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:29:48.937373 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:29:48.939740 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Registered counter for database nova_cell0 May 31 14:29:48.939976 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Registered counter for database nova_cell0 May 31 14:29:48.943760 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Registered counter for database nova_cell1 May 31 14:29:48.944155 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Registered counter for database nova_cell1 May 31 14:29:48.950892 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.953370 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.954596 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.957362 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:48.958425 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:48.960026 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:49.107116 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:49.117515 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Registered counter for database nova_cell0 May 31 14:29:49.122144 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:49.127007 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:49.132314 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:49.133962 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Registered counter for database nova_cell0 May 31 14:29:49.142690 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:29:49.146889 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:29:49.592701 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:29:49.595253 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:29:49.599991 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:29:49.602426 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:29:49.821610 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:29:49.823756 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:29:49.827514 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:29:49.829696 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:29:49.832616 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b8692f9c0 pid: 103331 (default app) May 31 14:29:49.834815 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b8692f9c0 pid: 103330 (default app) May 31 14:29:49.834942 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:29:49.836115 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-176567f5-0749-4920-bf8a-c8424ad4db21 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001971 May 31 14:29:49.836529 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Tue May 31 14:29:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:09.161183 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:09.163042 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002870 May 31 14:31:09.168496 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:09.180406 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:09.181696 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:09.182875 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell1:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:09.183931 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:09.623098 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-6b512685-bf3b-41b6-b8f0-8f78756c822d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:09.652087 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-6b512685-bf3b-41b6-b8f0-8f78756c822d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482357 May 31 14:31:09.652816 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1291 bytes} [Tue May 31 14:31:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:11.950229 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:11.951332 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-475e2e0b-f7a8-4d19-8f6a-3cc6b5d97300 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 31 14:31:11.951728 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 2/4] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:12.013551 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5e7c4417-90ad-4d33-8bc6-87f37f2b72e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:12.032582 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:31:12.032582 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 31 14:31:12.063073 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5e7c4417-90ad-4d33-8bc6-87f37f2b72e7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105531 May 31 14:31:12.063808 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 3/5] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:12.077288 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:12.078481 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell1:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:12.079282 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:12.080052 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:12.284038 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c8506744-6677-45ac-a4d8-1f026db0ab9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:12.286691 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:31:12.286691 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:31:12.346438 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c8506744-6677-45ac-a4d8-1f026db0ab9f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274273 May 31 14:31:12.347237 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 3/6] 10.222.0.67 () {64 vars in 1335 bytes} [Tue May 31 14:31:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:14.643132 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5e7c4417-90ad-4d33-8bc6-87f37f2b72e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:14.644721 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5e7c4417-90ad-4d33-8bc6-87f37f2b72e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 May 31 14:31:14.645593 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 4/7] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:14.761905 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-0101c1fa-1b1e-4068-8cfa-59a3d48e2a18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:14.779465 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:31:14.779465 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:31:14.799125 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-0101c1fa-1b1e-4068-8cfa-59a3d48e2a18 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142714 May 31 14:31:14.799687 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 4/8] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 14:31:14.811538 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-1ce333e9-0c3c-4606-af8f-842dbecef2fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:14.813780 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:31:14.813780 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: warnings.warn(msg) May 31 14:31:14.845054 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-1ce333e9-0c3c-4606-af8f-842dbecef2fa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037139 May 31 14:31:14.845683 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 5/9] 10.222.0.67 () {64 vars in 1335 bytes} [Tue May 31 14:31:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:31:17.156979 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-0101c1fa-1b1e-4068-8cfa-59a3d48e2a18 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:17.158005 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-0101c1fa-1b1e-4068-8cfa-59a3d48e2a18 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 31 14:31:17.158406 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:17.219570 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30a87673-eb6c-43c3-871f-3fb772663218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:17.242160 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30a87673-eb6c-43c3-871f-3fb772663218 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077437 May 31 14:31:17.243009 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 6/11] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:17.254927 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-545ac38e-66aa-4766-8575-e384999e5198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:17.277925 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-545ac38e-66aa-4766-8575-e384999e5198 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026810 May 31 14:31:17.278675 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 6/12] 10.222.0.67 () {64 vars in 1335 bytes} [Tue May 31 14:31:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:19.565962 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30a87673-eb6c-43c3-871f-3fb772663218 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:19.567035 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30a87673-eb6c-43c3-871f-3fb772663218 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 31 14:31:19.567439 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 7/13] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:19.628333 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-15327daa-0554-42cc-94bd-e081c075d53a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:19.645890 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-15327daa-0554-42cc-94bd-e081c075d53a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072349 May 31 14:31:19.646538 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 7/14] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:19.664916 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-fda26911-8b70-467a-9260-e0acfea57d86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:19.682583 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-fda26911-8b70-467a-9260-e0acfea57d86 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027871 May 31 14:31:19.683224 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 8/15] 10.222.0.67 () {64 vars in 1335 bytes} [Tue May 31 14:31:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:22.009730 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-15327daa-0554-42cc-94bd-e081c075d53a admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:22.010811 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-15327daa-0554-42cc-94bd-e081c075d53a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 31 14:31:22.011215 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 8/16] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:22.074251 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:22.093840 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075696 May 31 14:31:22.094396 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 9/17] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:22.106335 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a262c789-6780-42f8-a827-312415d00002 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:22.135996 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a262c789-6780-42f8-a827-312415d00002 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033406 May 31 14:31:22.137032 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 9/18] 10.222.0.67 () {64 vars in 1335 bytes} [Tue May 31 14:31:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:31:24.467553 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:24.469222 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 May 31 14:31:24.469653 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 10/19] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:24.534382 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-7bee9c2c-def4-4776-99f9-d72ff64cad84 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:24.560303 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-7bee9c2c-def4-4776-99f9-d72ff64cad84 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083636 May 31 14:31:24.562683 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 10/20] 10.222.0.67 () {60 vars in 1291 bytes} [Tue May 31 14:31:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:31:26.956413 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:26.957505 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-18a67e59-a6ca-4421-8af0-e0e80578616b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 31 14:31:26.957982 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 11/21] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:27.026382 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e534f2bd-c0cc-42c4-a204-43341f6aa527 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "swap": 0, "id": "1"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:27.044248 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e534f2bd-c0cc-42c4-a204-43341f6aa527 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080471 May 31 14:31:27.044806 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 11/22] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:27.060275 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-609ba9c3-f515-433d-9a0d-2ad69521324d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:27.089850 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-609ba9c3-f515-433d-9a0d-2ad69521324d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036436 May 31 14:31:27.091094 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 12/23] 10.222.0.67 () {64 vars in 1332 bytes} [Tue May 31 14:31:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:29.643215 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e534f2bd-c0cc-42c4-a204-43341f6aa527 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:29.644458 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e534f2bd-c0cc-42c4-a204-43341f6aa527 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 May 31 14:31:29.644916 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:29.709432 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-240dd542-b8d6-43d1-a209-14a2ed60fcb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:29.727339 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-240dd542-b8d6-43d1-a209-14a2ed60fcb9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076640 May 31 14:31:29.727898 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 13/25] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:29.742345 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-17dd5c55-f329-4b03-ae69-cbcf2e4822f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:29.764853 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-17dd5c55-f329-4b03-ae69-cbcf2e4822f6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026199 May 31 14:31:29.765454 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 13/26] 10.222.0.67 () {64 vars in 1332 bytes} [Tue May 31 14:31:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:32.125341 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-240dd542-b8d6-43d1-a209-14a2ed60fcb9 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:32.127085 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-240dd542-b8d6-43d1-a209-14a2ed60fcb9 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 May 31 14:31:32.127562 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:32.186588 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-38583e77-7706-49c2-8caa-0b60b1c87d8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:32.204139 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-38583e77-7706-49c2-8caa-0b60b1c87d8e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070573 May 31 14:31:32.204683 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 14/28] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 14:31:32.216503 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2ceeaa97-b6dc-4666-b905-00c444d772aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:32.239728 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2ceeaa97-b6dc-4666-b905-00c444d772aa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026933 May 31 14:31:32.240291 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 15/29] 10.222.0.67 () {64 vars in 1332 bytes} [Tue May 31 14:31:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:31:34.567859 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-38583e77-7706-49c2-8caa-0b60b1c87d8e admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:34.568895 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-38583e77-7706-49c2-8caa-0b60b1c87d8e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 31 14:31:34.569304 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 15/30] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:34.629170 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ab603fe6-765e-4d06-a9cf-a53378999dd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:34.647797 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ab603fe6-765e-4d06-a9cf-a53378999dd0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072349 May 31 14:31:34.648347 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 16/31] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 14:31:34.660306 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-eb3a462f-8e17-4859-a878-25a3b8ff58f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:34.683728 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-eb3a462f-8e17-4859-a878-25a3b8ff58f7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027035 May 31 14:31:34.684295 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 16/32] 10.222.0.67 () {64 vars in 1332 bytes} [Tue May 31 14:31:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:31:37.202043 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ab603fe6-765e-4d06-a9cf-a53378999dd0 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:31:37.203100 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ab603fe6-765e-4d06-a9cf-a53378999dd0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 31 14:31:37.203686 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 17/33] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:31:37.264841 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:37.282685 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073290 May 31 14:31:37.283371 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 17/34] 10.222.0.67 () {64 vars in 1282 bytes} [Tue May 31 14:31:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:31:37.296670 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-7da92333-b1cf-4b7a-8dba-13103b9aff7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:31:37.322512 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-7da92333-b1cf-4b7a-8dba-13103b9aff7d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030303 May 31 14:31:37.335100 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 18/35] 10.222.0.67 () {64 vars in 1332 bytes} [Tue May 31 14:31:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:32:01.111238 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:01.112296 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 31 14:32:01.112696 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 18/36] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:01.123139 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:01.174766 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8eed97ea-65b6-48b4-83e3-55c8fcf7da7b admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:01.192030 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-8eed97ea-65b6-48b4-83e3-55c8fcf7da7b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073479 May 31 14:32:01.192573 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 19/37] 10.222.0.67 () {60 vars in 1291 bytes} [Tue May 31 14:32:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:02.181853 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:02.182971 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-98bed4c0-1a4b-40e8-af9a-231fba642342 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 31 14:32:02.183376 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 19/38] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:02.386545 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-157e53cc-ec0e-4f9a-b0ba-5b600ce845ae admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:02.392699 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-157e53cc-ec0e-4f9a-b0ba-5b600ce845ae admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-157e53cc-ec0e-4f9a-b0ba-5b600ce845ae admin admin] Request method failure captured: May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept: application/json May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Host: 10.222.0.67 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABilibic2Wf2LRmVmzyGsC6ZT7wpMesDGrN7jEI7LR9Z_UC9uunAAYwaS3lVcfbOPnlRxB8utkBNdLvcHokMVPzgXWxLH6iqTHuGv0p8y7UsoblJOC4eYqU0DjiSeEan75OdHghmmA_Dd55XOBzKoZO9KsXNi1YjZUcfL7mijHFbK5ela8 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Role: admin,reader,member May 31 14:32:02.395965 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Roles: admin,reader,member May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User: admin May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: method: > May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: exception: Flavor 42 could not be found. May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: action_args: {'id': '42'} May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:02.397627 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:02.398841 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:02.400325 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-157e53cc-ec0e-4f9a-b0ba-5b600ce845ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:02.401581 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-157e53cc-ec0e-4f9a-b0ba-5b600ce845ae admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061116 May 31 14:32:02.401581 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 20/39] 10.222.0.67 () {60 vars in 1190 bytes} [Tue May 31 14:32:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 14:32:02.407000 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-1b4a4f22-c190-482e-a091-06f4070bea84 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:02.409933 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:02.429495 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-1b4a4f22-c190-482e-a091-06f4070bea84 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026041 May 31 14:32:02.430036 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 20/40] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:02.466134 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-296e5eab-d13c-49fc-a660-cb482b023a02 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:02.487696 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-296e5eab-d13c-49fc-a660-cb482b023a02 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025165 May 31 14:32:02.488223 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 21/41] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:02.497330 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-fd7512b3-dc35-45a2-b43a-95d9f1dae315 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:02.504189 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-fd7512b3-dc35-45a2-b43a-95d9f1dae315 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-fd7512b3-dc35-45a2-b43a-95d9f1dae315 admin admin] Request method failure captured: May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept: application/json May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Host: 10.222.0.67 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABilibic2Wf2LRmVmzyGsC6ZT7wpMesDGrN7jEI7LR9Z_UC9uunAAYwaS3lVcfbOPnlRxB8utkBNdLvcHokMVPzgXWxLH6iqTHuGv0p8y7UsoblJOC4eYqU0DjiSeEan75OdHghmmA_Dd55XOBzKoZO9KsXNi1YjZUcfL7mijHFbK5ela8 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Role: admin,reader,member May 31 14:32:02.507479 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Roles: admin,reader,member May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User: admin May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: method: > May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: exception: Flavor 42 could not be found. May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: action_args: {'id': '42'} May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:02.508850 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:02.509648 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:02.511025 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-fd7512b3-dc35-45a2-b43a-95d9f1dae315 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:02.512252 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-fd7512b3-dc35-45a2-b43a-95d9f1dae315 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015148 May 31 14:32:02.512252 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 21/42] 10.222.0.67 () {60 vars in 1190 bytes} [Tue May 31 14:32:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 14:32:03.371311 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-296e5eab-d13c-49fc-a660-cb482b023a02 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:03.372308 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-296e5eab-d13c-49fc-a660-cb482b023a02 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 31 14:32:03.372700 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 22/43] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:03.561371 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a68ffc3d-ae3b-42d6-ac4e-e610bf27a484 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:03.567397 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-a68ffc3d-ae3b-42d6-ac4e-e610bf27a484 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a68ffc3d-ae3b-42d6-ac4e-e610bf27a484 admin admin] Request method failure captured: May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept: application/json May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Host: 10.222.0.67 May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABilibj2a-UZRVDDJgQBsii3J_9n_sZXJJ6h4t0KJJOuC1AOsgZwnVgyHPXturxjzM4cUhTicni2cavXaPutrzG1zEIFWZDS92OHAHEhYZxf_CNKhQAKYlPE49GD4mliChKcvn_SQIQxqZHJ4zVoXo4hdhxGup91kiPf14Eh583t7AS-Dg May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Role: admin,reader,member May 31 14:32:03.568893 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Roles: admin,reader,member May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User: admin May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: method: > May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: exception: Flavor 84 could not be found. May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: action_args: {'id': '84'} May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:03.570773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:03.571692 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:03.572966 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a68ffc3d-ae3b-42d6-ac4e-e610bf27a484 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:03.574219 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a68ffc3d-ae3b-42d6-ac4e-e610bf27a484 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061016 May 31 14:32:03.574219 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 22/44] 10.222.0.67 () {60 vars in 1190 bytes} [Tue May 31 14:32:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 14:32:03.580203 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-da22ae3b-ff01-4ede-a8f7-3b86f60bebc4 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:03.593992 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-da22ae3b-ff01-4ede-a8f7-3b86f60bebc4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017365 May 31 14:32:03.594506 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 23/45] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:03.603444 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c552a56b-46df-4e84-9051-88ae8fc4fef4 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:03.617436 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c552a56b-46df-4e84-9051-88ae8fc4fef4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017452 May 31 14:32:03.617960 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:03.626801 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ab8f8fa0-e34e-4de5-be21-948144b0c0d7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:03.632006 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-ab8f8fa0-e34e-4de5-be21-948144b0c0d7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ab8f8fa0-e34e-4de5-be21-948144b0c0d7 admin admin] Request method failure captured: May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept: application/json May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Host: 10.222.0.67 May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABilibj2a-UZRVDDJgQBsii3J_9n_sZXJJ6h4t0KJJOuC1AOsgZwnVgyHPXturxjzM4cUhTicni2cavXaPutrzG1zEIFWZDS92OHAHEhYZxf_CNKhQAKYlPE49GD4mliChKcvn_SQIQxqZHJ4zVoXo4hdhxGup91kiPf14Eh583t7AS-Dg May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Role: admin,reader,member May 31 14:32:03.633490 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Roles: admin,reader,member May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User: admin May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: method: > May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: exception: Flavor 84 could not be found. May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: action_args: {'id': '84'} May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:03.635007 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:03.636152 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:03.637471 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ab8f8fa0-e34e-4de5-be21-948144b0c0d7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:03.638714 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ab8f8fa0-e34e-4de5-be21-948144b0c0d7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011378 May 31 14:32:03.638714 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 24/47] 10.222.0.67 () {60 vars in 1190 bytes} [Tue May 31 14:32:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 31 14:32:04.538696 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c552a56b-46df-4e84-9051-88ae8fc4fef4 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:04.539708 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c552a56b-46df-4e84-9051-88ae8fc4fef4 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 31 14:32:04.540110 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 24/48] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:04.728524 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d7333da7-ab1a-43e1-8fbe-2fde877e9f76 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:04.734767 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-d7333da7-ab1a-43e1-8fbe-2fde877e9f76 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d7333da7-ab1a-43e1-8fbe-2fde877e9f76 admin admin] Request method failure captured: May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept: application/json May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Connection: keep-alive May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Content-Length: 0 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Host: 10.222.0.67 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABilibkI06IiHPN8TpH7BWTOypPa1qewGmGhGDaTi-wrljOu2A2c9gM3LNDMsm_KJWDCnhXl_g_k-jS4Q64aknoTSn0BRs0PI9IqAEnFTEsv2VpxNGs8uE7aCL1anVeXSauG7uSNn7Ep6-TxIW08ZuOylF344oTEnDm0qFnUJS6lzU1dU8 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Id: None May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Domain-Name: None May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Project-Name: admin May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Role: admin,reader,member May 31 14:32:04.736258 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Roles: admin,reader,member May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant: admin May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User: admin May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: X-User-Name: admin May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: method: > May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: exception: Flavor 451 could not be found. May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: action_args: {'id': '451'} May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:04.737763 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:04.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi May 31 14:32:04.740464 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d7333da7-ab1a-43e1-8fbe-2fde877e9f76 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:04.741729 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d7333da7-ab1a-43e1-8fbe-2fde877e9f76 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062225 May 31 14:32:04.741729 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 25/49] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:32:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 14:32:04.747750 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-7defba88-1a0b-4499-90c7-053945ab9505 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:04.761945 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-7defba88-1a0b-4499-90c7-053945ab9505 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018044 May 31 14:32:04.762702 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 25/50] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:04.771731 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:04.785168 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016959 May 31 14:32:04.785683 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 26/51] 10.222.0.67 () {60 vars in 1210 bytes} [Tue May 31 14:32:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:32:04.794681 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-d8118bea-c409-43d2-b61a-6c54adcc3b40 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:04.800577 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-d8118bea-c409-43d2-b61a-6c54adcc3b40 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-d8118bea-c409-43d2-b61a-6c54adcc3b40 admin admin] Request method failure captured: May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept: application/json May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Host: 10.222.0.67 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABilibkI06IiHPN8TpH7BWTOypPa1qewGmGhGDaTi-wrljOu2A2c9gM3LNDMsm_KJWDCnhXl_g_k-jS4Q64aknoTSn0BRs0PI9IqAEnFTEsv2VpxNGs8uE7aCL1anVeXSauG7uSNn7Ep6-TxIW08ZuOylF344oTEnDm0qFnUJS6lzU1dU8 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Role: admin,reader,member May 31 14:32:04.802070 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Roles: admin,reader,member May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_929ceca16868457ca23cb37daf0ee36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 929ceca16868457ca23cb37daf0ee36d May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User: admin May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Id: c01eab2db7454d578ce76aa7d022d460 May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: method: > May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: exception: Flavor 451 could not be found. May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: action_args: {'id': '451'} May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:32:04.803722 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:04.804657 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 31 14:32:04.806073 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-d8118bea-c409-43d2-b61a-6c54adcc3b40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:32:04.807354 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-d8118bea-c409-43d2-b61a-6c54adcc3b40 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012276 May 31 14:32:04.807354 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 26/52] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:32:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 31 14:32:05.667769 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:05.668783 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 31 14:32:05.669183 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 27/53] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:05.858902 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-6bcf1b61-2ee9-486e-b2d2-cb9184a7909c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:32:05.877119 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-6bcf1b61-2ee9-486e-b2d2-cb9184a7909c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070897 May 31 14:32:05.877602 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 27/54] 10.222.0.67 () {64 vars in 1235 bytes} [Tue May 31 14:32:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:32:06.741612 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:06.742635 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 May 31 14:32:06.743051 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 28/55] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:06.938043 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-eca5e2cd-7b6b-4aa8-bb0a-8693ada97b23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:32:06.956365 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-eca5e2cd-7b6b-4aa8-bb0a-8693ada97b23 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068873 May 31 14:32:06.956922 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 28/56] 10.222.0.67 () {64 vars in 1235 bytes} [Tue May 31 14:32:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:32:07.839285 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:07.840281 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 31 14:32:07.840683 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 29/57] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:08.026775 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-8a500b40-e6fd-4d0f-afcb-5a7b8c759048 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:32:08.044037 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-8a500b40-e6fd-4d0f-afcb-5a7b8c759048 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067803 May 31 14:32:08.044585 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 29/58] 10.222.0.67 () {64 vars in 1235 bytes} [Tue May 31 14:32:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:32:08.919016 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:08.920024 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 31 14:32:08.920420 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 30/59] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:09.109665 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-8d31bdc3-5bce-4cdb-9c5f-68c992fcda6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:32:09.127492 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-8d31bdc3-5bce-4cdb-9c5f-68c992fcda6f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069763 May 31 14:32:09.128087 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 30/60] 10.222.0.67 () {64 vars in 1235 bytes} [Tue May 31 14:32:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:32:09.999927 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:10.000934 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 May 31 14:32:10.001332 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 31/61] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:32:10.188205 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e1c7ed34-4a24-401d-a3fa-bfea4d601dfb admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:32:10.208740 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e1c7ed34-4a24-401d-a3fa-bfea4d601dfb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071816 May 31 14:32:10.209332 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 31/62] 10.222.0.67 () {60 vars in 1202 bytes} [Tue May 31 14:32:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:33:11.459266 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.460278 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-46919af3-c701-4f8d-b896-bc9d152fb5e7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 31 14:33:11.460680 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 32/63] 10.222.0.67 () {54 vars in 930 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:33:11.468104 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:11.520604 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-28db17b1-a274-4fc5-b558-b5cc1cbfdd7e admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.539645 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-28db17b1-a274-4fc5-b558-b5cc1cbfdd7e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072648 May 31 14:33:11.540188 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 32/64] 10.222.0.67 () {60 vars in 1291 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:33:11.561770 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=14 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:11.565462 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-affd71be-1621-4562-ae4a-62a675c038d3 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.573443 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-affd71be-1621-4562-ae4a-62a675c038d3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013775 May 31 14:33:11.573972 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 33/65] 10.222.0.67 () {60 vars in 1282 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:33:11.585300 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-afd9c06d-0c03-4d7c-a94e-b7d17dc5bc9e admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.592858 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-afd9c06d-0c03-4d7c-a94e-b7d17dc5bc9e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011091 May 31 14:33:11.593375 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 33/66] 10.222.0.67 () {60 vars in 1285 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:33:11.604484 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.612510 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011615 May 31 14:33:11.613025 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 34/67] 10.222.0.67 () {60 vars in 1285 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:33:11.624743 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-fa65c62c-8132-42f9-a7ca-48525b3e1ec1 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:33:11.632300 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-fa65c62c-8132-42f9-a7ca-48525b3e1ec1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011673 May 31 14:33:11.632809 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 34/68] 10.222.0.67 () {60 vars in 1282 bytes} [Tue May 31 14:33:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:36:32.087527 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:32.088547 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 31 14:36:32.088953 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 35/69] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:36:32.245450 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=6 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:36:32.369172 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:32.370329 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:36:32.370329 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:36:32.371551 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:32.371989 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:32.372783 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:32.373241 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:32.406112 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a6578a84-0ab2-4081-ac6e-7200f2f6a297 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.165592 May 31 14:36:32.406690 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 35/70] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:36:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:36:33.274625 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:33.275671 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 31 14:36:33.276063 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 36/71] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:36:33.466355 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:33.467605 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:36:33.467605 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:36:33.468796 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:33.469242 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:33.470107 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:33.470534 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:33.491637 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-2432bea5-421a-4956-afe6-91bfd191ab84 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078688 May 31 14:36:33.492199 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 36/72] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:36:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:36:44.791201 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:44.792213 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 31 14:36:44.792618 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 37/73] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:36:44.932027 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:36:44.932740 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell1:SELECT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:36:44.933353 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=8 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:36:44.983097 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:44.984310 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:36:44.984310 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:36:44.985489 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:44.985956 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:44.986760 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:44.987228 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:45.011968 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-7ff40743-32fd-4aee-a396-e6438bbe8b69 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084310 May 31 14:36:45.012508 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 37/74] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:36:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:36:45.878207 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:45.879245 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-30d0d906-f0f1-41e7-9462-fa1c8a1a0adb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 31 14:36:45.879672 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 38/75] 10.222.0.67 () {56 vars in 1074 bytes} [Tue May 31 14:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:36:46.078393 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:36:46.079600 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:36:46.079600 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 31 14:36:46.080773 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:46.081281 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:46.082067 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:36:46.082542 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:36:46.104470 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-3639d293-789e-4743-843f-2e5706908473 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081717 May 31 14:36:46.105008 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 38/76] 10.222.0.67 () {60 vars in 1193 bytes} [Tue May 31 14:36:46 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:37:43.914312 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: Tue May 31 14:37:43 2022 - graceful shutdown triggered... May 31 14:37:43.914922 dv-cinder-839793-14-iscsi devstack@n-api.service[103331]: Gracefully killing worker 2 (pid: 103331)... May 31 14:37:43.915286 dv-cinder-839793-14-iscsi devstack@n-api.service[103330]: Gracefully killing worker 1 (pid: 103330)... May 31 14:37:43.917048 dv-cinder-839793-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 31 14:37:44.915273 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: worker 1 buried after 1 seconds May 31 14:37:44.915273 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: worker 2 buried after 1 seconds May 31 14:37:44.915273 dv-cinder-839793-14-iscsi devstack@n-api.service[103329]: goodbye to uWSGI. May 31 14:37:44.917342 dv-cinder-839793-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 31 14:37:44.917912 dv-cinder-839793-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 31 14:37:44.920607 dv-cinder-839793-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 14:37:44.935813 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 14:37:44 2022] *** May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: nodename: dv-cinder-839793-14-iscsi May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: machine: x86_64 May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: clock source: unix May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: pcre jit disabled May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: detected number of CPU cores: 4 May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: current working directory: / May 31 14:37:44.951131 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: detected binary path: /usr/bin/uwsgi-core May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: your processes number limit is 47680 May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: your memory page size is 4096 bytes May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: detected max file descriptor number: 2048 May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: lock engine: pthread robust mutexes May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: thunder lock: enabled May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 14:37:44.951907 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 14:37:44.997737 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: Python main interpreter initialized at 0x556e947fb9c0 May 31 14:37:44.997737 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: python threads support enabled May 31 14:37:44.997737 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: your server socket listen backlog is limited to 100 connections May 31 14:37:44.997737 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: your mercy for graceful operations on workers is 90 seconds May 31 14:37:44.998285 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: mapped 403077 bytes (393 KB) for 2 cores May 31 14:37:44.998285 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: *** Operational MODE: preforking *** May 31 14:37:44.998433 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: *** uWSGI is running in multiple interpreter mode *** May 31 14:37:44.998433 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: spawned uWSGI master process (pid: 124092) May 31 14:37:44.998693 dv-cinder-839793-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 14:37:44.999266 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: spawned uWSGI worker 1 (pid: 124106, cores: 1) May 31 14:37:44.999609 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: spawned uWSGI worker 2 (pid: 124107, cores: 1) May 31 14:37:44.999758 dv-cinder-839793-14-iscsi devstack@n-api.service[124092]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 14:37:46.243282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 14:37:46.247767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 14:37:47.073208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:37:47.073208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: from cryptography.utils import int_from_bytes May 31 14:37:47.073533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:37:47.073533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: from cryptography.utils import int_from_bytes May 31 14:37:47.080797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:37:47.080797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: from cryptography.utils import int_from_bytes May 31 14:37:47.081139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:37:47.081139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: from cryptography.utils import int_from_bytes May 31 14:37:49.498553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:37:49.499119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:37:49.499270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:37:49.499817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:37:49.500251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:37:49.500796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.501132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.501453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.501934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.502419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.502938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.503436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.503927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.504418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.504848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.505333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.505822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-14-iscsi {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.506303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.506799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.507261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.507744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.508218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.508696 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.509156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.510468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.510977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.511457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.511915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.512399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.512879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.513351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.513835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.514113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:37:49.514530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:37:49.514909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:37:49.515042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.515256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.515379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:37:49.515576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:37:49.515675 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.515891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-14-iscsi {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516654 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.516961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.517902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.518931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-14-iscsi {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.519948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.520908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521654 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.521862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.522852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.523506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.523506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.523801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.523801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.524916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.525068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.525860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526695 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-14-iscsi {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.526856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527619 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.527770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.528546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.528711 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.528857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.529923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.530973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531135 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.531971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.532873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.533939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.534869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.535998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.536893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.537057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.537398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.537549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.537703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.537858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.538027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.538670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.538925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.539077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.539237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.539412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.539706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.539863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.540997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.541972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.542265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.542410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.542571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.542767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.542921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.543978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544130 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.544888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.545913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.546887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547501 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.547955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.548100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.548739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.548915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.549944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550536 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.550860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.551015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.551166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.551536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.552267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.552429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.552584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.552730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.552872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.553024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.553428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.553598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.553747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.553913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.554071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.554218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.554370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.554523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.554745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.554905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.555190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.555379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.555379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.555665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.555819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.556012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.556165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.556317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.556897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.557052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.557601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.557761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.557922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.558078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.558238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.558983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.559195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.559465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.559628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.559783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.559937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.560089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.560244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.560389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.560533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.560676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.560866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.561016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.561170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.561341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.561597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.561755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.561908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.562061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.562219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.562219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.562515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.562745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.562908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.563060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.563287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.563435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.563579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.563737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.563737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.564034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.564189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:37:49.564342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.564486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.564639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.565968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.566733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.566905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.567892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.568037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.568189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.568334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.568517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.569964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.570908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.571896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.572575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.572755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.572913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.573940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.574980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575698 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.575973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.576992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.577958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.578874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579422 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.579955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.580889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581666 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.581985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.582955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.583962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.584937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.585991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.586914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.587742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.588875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.589969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590741 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.590953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.591057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.591343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.591649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.591953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.592963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.593903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.594925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.595097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.595252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.595349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.595609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.595949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.596264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.596584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.596704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.596945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.597280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.597608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.597856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.597963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.598957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.599175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.599443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.599602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.599824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.599921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600502 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.600822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.601964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602578 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.602914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.603974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.604920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.605849 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.606851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.607959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.608969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.609955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610406 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.610849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.611808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.612937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.613850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.614895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.615824 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.616971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.617076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.617276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.617419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.617581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.617718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.618925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.619912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.620985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.621987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.622195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.622295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.622511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.622605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.622851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.623858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624070 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624478 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.624808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.625977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.626909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.627924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.628825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629422 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.629923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.630947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.631862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.632980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.633998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.634204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.634300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.635838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.636931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.637937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.638872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.639837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.640900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641502 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.641896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642518 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.642873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.643977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.644908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.645932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.646853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.647789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.648921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.649963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.650244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.650887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.651830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.652931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.653973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.654928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655779 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.655897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.656799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.657934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.658993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.659941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660765 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.660892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.661996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.662951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.663965 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.664930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.665101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.665244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.665410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.665551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.665711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.666778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667695 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.667800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.668944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.669891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.670959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.671885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.672999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.673168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.673300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.673476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.673651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.673783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.674771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.675956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676383 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.676983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.677902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.678866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.679806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.680962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.681067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.681271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.681916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.682886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.683809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.684937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.685957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.686942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687696 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.687792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.688940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689646 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.689948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.690944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.691434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.691593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.691762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.691858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.692856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693678 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.693980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.694928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.695942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.696148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.696252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.696450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.696752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.696875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.697637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.697786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.697972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.698933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.699954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.700937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.701862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.702826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.703976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.704910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705316 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.705843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706536 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.706931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.707832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.708954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.709920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.710931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711151 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.711880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712106 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.712877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713777 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.713987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.714927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715543 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.715874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.716919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.717806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.718979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.719941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.720855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.721986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.722919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723305 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.723920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.724131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.724360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.724458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.724706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.724809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.725939 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.726991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.727920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.728864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.729976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.730272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.730376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.730591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.730727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.730919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.731932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732131 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.732827 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.733947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.734989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.735932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.736847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.737765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.738984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739646 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.739962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.740891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.741816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.742969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.743130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.743276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.743371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.743583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.743687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.744399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.744547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.744707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.744802 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.745932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.746930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.747871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748002 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.748929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.749854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750063 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.750914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751685 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.751982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.752904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.753926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.754931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.755808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.756950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.757962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.758900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.759091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.759194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.759390 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.759485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.760990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.761897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.762950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.763964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764586 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.764893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.765929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.766899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.767833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.768961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.769066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.769238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:37:49.769333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.769592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.769891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.770213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.770529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.770868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.771183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.771492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.771818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.772126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.772431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.772743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.773050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.773357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.773668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.773978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.774299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.774621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.774951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.775304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.775629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.775981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.776296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.776638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.776964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.777279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.777589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.777895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:37:49.778139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:37:49.829120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO dbcounter [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Registered counter for database nova_api May 31 14:37:49.837264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO dbcounter [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Registered counter for database nova_api May 31 14:37:49.849244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_db.sqlalchemy.engines [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.855963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writer thread running {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:49.856642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_db.sqlalchemy.engines [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.863105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writer thread running {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:49.913365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.context [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f(cell1) {{(pid=124106) load_cells /opt/stack/nova/nova/context.py:464}} May 31 14:37:49.917565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:37:49.919185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:37:49.919911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.context [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f(cell1) {{(pid=124107) load_cells /opt/stack/nova/nova/context.py:464}} May 31 14:37:49.920095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:37:49.921928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:37:49.923934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO dbcounter [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Registered counter for database nova_cell0 May 31 14:37:49.924059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:37:49.925595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:37:49.926385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:37:49.927974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO dbcounter [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Registered counter for database nova_cell1 May 31 14:37:49.928338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:37:49.930287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO dbcounter [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Registered counter for database nova_cell0 May 31 14:37:49.934865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO dbcounter [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Registered counter for database nova_cell1 May 31 14:37:49.936378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_db.sqlalchemy.engines [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.940411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_db.sqlalchemy.engines [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.942452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_db.sqlalchemy.engines [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.942780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writer thread running {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:49.943918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_db.sqlalchemy.engines [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:49.950807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writer thread running {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:49.952924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writer thread running {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:50.085820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writer thread running {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:50.095292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO dbcounter [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Registered counter for database nova_cell0 May 31 14:37:50.097568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO dbcounter [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Registered counter for database nova_cell0 May 31 14:37:50.102826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_db.sqlalchemy.engines [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:50.105352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_db.sqlalchemy.engines [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:37:50.107561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writer thread running {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:50.109889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writer thread running {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:37:50.546835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: WARNING keystonemiddleware.auth_token [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:37:50.554481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: WARNING keystonemiddleware.auth_token [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:37:50.576271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: WARNING keystonemiddleware.auth_token [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:37:50.583891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: WARNING keystonemiddleware.auth_token [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:37:50.785336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: WARNING keystonemiddleware.auth_token [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:37:50.791992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: WARNING keystonemiddleware.auth_token [None req-4eda3a73-9454-4851-85b9-6be58a1e9904 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:37:50.797312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556e947fb9c0 pid: 124106 (default app) May 31 14:37:50.811828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: WARNING keystonemiddleware.auth_token [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 14:37:50.818116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: WARNING keystonemiddleware.auth_token [None req-51364ae1-9ec8-4011-b146-af30a61dfbc5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 14:37:50.824025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556e947fb9c0 pid: 124107 (default app) May 31 14:38:32.272164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.273390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.274252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.276147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.423616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.424813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.426829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:32.427848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:33.592540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8fcc128d-f683-4185-a69b-cbc5cae67ce4 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Action: 'create', calling method: .version_select at 0x7f8dc56c0280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1016610596", "metadata": {"Type": "work"}}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8fcc128d-f683-4185-a69b-cbc5cae67ce4 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 122 May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:33.615444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1016610596", "metadata": {"Type": "work"}}} May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:33.617154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1016610596', 'metadata': {'Type': 'work'}}}} May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise error May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi '#$%' May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:33.618198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 14:38:33.620087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 14:38:33.621522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 14:38:33.621522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:33.621522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8fcc128d-f683-4185-a69b-cbc5cae67ce4 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:33.622469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8fcc128d-f683-4185-a69b-cbc5cae67ce4 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.356369 May 31 14:38:33.623543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1155 bytes} [Tue May 31 14:38:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 14:38:33.632805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d44717f4-72ff-468d-8b77-426813ee22af tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc5558670>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:33.762327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b5800254-0785-4f45-944e-fbe1e659124e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Action: 'create', calling method: .version_select at 0x7f8dc56c1310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-329352502", "metadata": {"Type": "work"}}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:34.500640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d44717f4-72ff-468d-8b77-426813ee22af tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/9c8a8737-eea6-468a-aef7-39b15d4383a0" status: 200 len: 351 microversion: 2.1 time: 0.875574 May 31 14:38:34.501197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 2/2] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:33 2022] GET /compute/v2.1/os-volumes/9c8a8737-eea6-468a-aef7-39b15d4383a0 => generated 351 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:34.506184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c6606de6-15a8-483f-bbc8-d4ccd3e3d2e5 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Action: 'create', calling method: .version_select at 0x7f8dc553b700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-3304979", "metadata": {"Type": "work"}}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c6606de6-15a8-483f-bbc8-d4ccd3e3d2e5 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 117 May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:34.525004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-3304979", "metadata": {"Type": "work"}}} May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:34.526288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-3304979', 'metadata': {'Type': 'work'}}}} May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise error May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi '0' May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:34.527332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 14:38:34.528721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 14:38:34.529869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 14:38:34.529869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.529869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c6606de6-15a8-483f-bbc8-d4ccd3e3d2e5 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:34.529869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c6606de6-15a8-483f-bbc8-d4ccd3e3d2e5 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027048 May 31 14:38:34.541608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 3/3] 10.222.0.67 () {60 vars in 1155 bytes} [Tue May 31 14:38:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 14:38:34.549467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e9d59f2-ca6b-4406-8b0e-409aa7d9ed4f tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Action: 'create', calling method: .version_select at 0x7f8dc5547550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-912741586", "metadata": {"Type": "work"}}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e9d59f2-ca6b-4406-8b0e-409aa7d9ed4f tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 118 May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:34.561135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-912741586", "metadata": {"Type": "work"}}} May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:34.562877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-912741586', 'metadata': {'Type': 'work'}}}} May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise error May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi '' May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:34.563760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 14:38:34.565332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 14:38:34.566986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 14:38:34.566986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:34.568985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e9d59f2-ca6b-4406-8b0e-409aa7d9ed4f tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:34.572360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0e9d59f2-ca6b-4406-8b0e-409aa7d9ed4f tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029680 May 31 14:38:34.573095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 4/4] 10.222.0.67 () {60 vars in 1155 bytes} [Tue May 31 14:38:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 14:38:34.591604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57ab3c66-7d5c-434c-b3fa-fe2f4059a2cb tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Calling method '.version_select at 0x7f8dc553bf70>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:35.317860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-57ab3c66-7d5c-434c-b3fa-fe2f4059a2cb tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] HTTP exception thrown: Volume tempest-invalid-1766810464 could not be found. May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57ab3c66-7d5c-434c-b3fa-fe2f4059a2cb tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1766810464 HTTP/1.1 May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:35.328239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume tempest-invalid-1766810464 could not be found. May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'tempest-invalid-1766810464'} May 31 14:38:35.329599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1766810464 could not be found. (HTTP 404) (Request-ID: req-eda2fdb9-db11-413b-9d3a-027d1746676f) May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.330563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 14:38:35.331793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1766810464 could not be found. May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:38:35.332934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1766810464 could not be found. May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1766810464 could not be found. May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57ab3c66-7d5c-434c-b3fa-fe2f4059a2cb tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 404 to user: Volume tempest-invalid-1766810464 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-57ab3c66-7d5c-434c-b3fa-fe2f4059a2cb tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1766810464" status: 404 len: 99 microversion: 2.1 time: 0.749845 May 31 14:38:35.336317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1217 bytes} [Tue May 31 14:38:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1766810464 => generated 99 bytes in 751 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 31 14:38:35.341352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3860c152-c4bf-4593-99ea-3b10446b9071 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004431 May 31 14:38:35.346435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1139 bytes} [Tue May 31 14:38:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 31 14:38:35.351770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-03a0f4a8-1f3a-465a-86ae-c34846c30d68 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004211 May 31 14:38:35.358034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 7/7] 10.222.0.67 () {58 vars in 1136 bytes} [Tue May 31 14:38:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 31 14:38:35.388963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e38f9dd7-5c68-43f6-9c22-5f86884dcb97 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Calling method '.version_select at 0x7f8dc549f8b0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:35.441200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b5800254-0785-4f45-944e-fbe1e659124e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.022873 May 31 14:38:35.441845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1/8] 10.222.0.67 () {60 vars in 1155 bytes} [Tue May 31 14:38:32 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3026 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 14:38:35.459026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dd24efcf-6004-42d4-8bec-a3659990077f tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Calling method '.version_select at 0x7f8dc5588310>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:35.842098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-e38f9dd7-5c68-43f6-9c22-5f86884dcb97 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] HTTP exception thrown: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e38f9dd7-5c68-43f6-9c22-5f86884dcb97 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/os-volumes/68dd5762-1bc7-4040-96bb-dcb5b976c9e3 HTTP/1.1 May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:35.845107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '68dd5762-1bc7-4040-96bb-dcb5b976c9e3'} May 31 14:38:35.846963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. (HTTP 404) (Request-ID: req-2ba5365f-0f36-4b5a-8e50-f5dcab191045) May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.848619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 14:38:35.850355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 14:38:35.852217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. May 31 14:38:35.853975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.856680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e38f9dd7-5c68-43f6-9c22-5f86884dcb97 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 404 to user: Volume 68dd5762-1bc7-4040-96bb-dcb5b976c9e3 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:35.857879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e38f9dd7-5c68-43f6-9c22-5f86884dcb97 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/68dd5762-1bc7-4040-96bb-dcb5b976c9e3" status: 404 len: 109 microversion: 2.1 time: 0.498783 May 31 14:38:35.864019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 8/9] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 14:38:35 2022] DELETE /compute/v2.1/os-volumes/68dd5762-1bc7-4040-96bb-dcb5b976c9e3 => generated 109 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:38:35.873907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6c0fa366-0ae2-4ff7-93ac-08d3e9c6f6d0 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Calling method '.version_select at 0x7f8dc553b820>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:35.901395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dd24efcf-6004-42d4-8bec-a3659990077f tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86" status: 200 len: 353 microversion: 2.1 time: 0.447585 May 31 14:38:35.909561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 2/10] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:35 2022] GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 => generated 353 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:38:35.992251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-6c0fa366-0ae2-4ff7-93ac-08d3e9c6f6d0 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] HTTP exception thrown: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6c0fa366-0ae2-4ff7-93ac-08d3e9c6f6d0 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Request method failure captured: May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/os-volumes/1357ebea-7dd1-407b-bc0a-7483db4b5bcc HTTP/1.1 May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihomcu2IFOvUpwH8Qs2nskc11BguCiyDsve9MdnSoXT94DypKaSscnW-VWv0C11fckykUOyEILoLTUQPW3QIf0mYLbZCRbXPH_5tV0qHUFm-jDMRYyUOjidjzYiYz71BD1mgrxGi4hXJXE63BVpEuz1cFTr-oJBVAB5kTmNdLdYBDE May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:35.994926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ebca4039f664206a5e793438f28b98f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ebca4039f664206a5e793438f28b98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 2ebca4039f664206a5e793438f28b98f May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesNegativeTest-787915562 May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 2c73c11b11c74540bb46302363604730 May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesNegativeTest-787915562-project May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '1357ebea-7dd1-407b-bc0a-7483db4b5bcc'} May 31 14:38:35.996495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. (HTTP 404) (Request-ID: req-4305b852-6199-4214-b290-66df6a77c669) May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:35.997441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 14:38:35.998933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 14:38:36.000395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6c0fa366-0ae2-4ff7-93ac-08d3e9c6f6d0 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] Returning 404 to user: Volume 1357ebea-7dd1-407b-bc0a-7483db4b5bcc could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:36.001778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6c0fa366-0ae2-4ff7-93ac-08d3e9c6f6d0 tempest-VolumesNegativeTest-787915562 tempest-VolumesNegativeTest-787915562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1357ebea-7dd1-407b-bc0a-7483db4b5bcc" status: 404 len: 109 microversion: 2.1 time: 0.128999 May 31 14:38:36.003234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 9/11] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:35 2022] GET /compute/v2.1/os-volumes/1357ebea-7dd1-407b-bc0a-7483db4b5bcc => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:38:36.014729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-60c98f86-5b02-409d-a8d7-0e6b26830b35 tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Calling method '.version_select at 0x7f8dc553bf70>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:36.016860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1974879392", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "networks": [{"uuid": "f6c64fe9-695a-41ef-8f9a-8ca49eddaccf"}]}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:36.112475 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-60c98f86-5b02-409d-a8d7-0e6b26830b35 tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86" status: 200 len: 353 microversion: 2.1 time: 0.108052 May 31 14:38:36.113116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 10/12] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:36 2022] GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:36.131589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ead39aed-2c6a-4c9a-888d-610470ecf8aa tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Calling method '.version_select at 0x7f8dc5547ca0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:36.264291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] validate_networks() for [('f6c64fe9-695a-41ef-8f9a-8ca49eddaccf', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:38:36.269448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ead39aed-2c6a-4c9a-888d-610470ecf8aa tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86" status: 202 len: 0 microversion: 2.1 time: 0.142752 May 31 14:38:36.273725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 11/13] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 14:38:36 2022] DELETE /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 14:38:36.280870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f8fae3b-2210-40b0-9c94-1790b362efe5 tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Calling method '.version_select at 0x7f8dc549f670>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:36.359484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f8fae3b-2210-40b0-9c94-1790b362efe5 tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86" status: 200 len: 352 microversion: 2.1 time: 0.081504 May 31 14:38:36.362874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 12/14] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:36 2022] GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:36.645250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f0f8325f-2ce5-435b-9ab3-53dbedb48c9d tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc549fee0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:36.735355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f0f8325f-2ce5-435b-9ab3-53dbedb48c9d tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cfac6915-4466-44ad-8528-408b2566f9cb" status: 200 len: 351 microversion: 2.1 time: 0.089803 May 31 14:38:36.736562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 13/15] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:36 2022] GET /compute/v2.1/os-volumes/cfac6915-4466-44ad-8528-408b2566f9cb => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:38:37.371022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ec3fea65-b81f-4d90-b53f-9eab2863505e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Calling method '.version_select at 0x7f8dc549f5e0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:37.585014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:38:37.585615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:38:37.586217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:38:37.587523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:38:37.588085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:38:37.631086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:37.632555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:37.635884 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:37.639540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:37.751103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Getting quotas for project 0300307fde534d49a050041217cfe6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:38:37.775447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Getting quotas for user ea126c816da740dda9622f7bfa10dd16 and project 0300307fde534d49a050041217cfe6e1. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:38:37.818826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:38:37.822308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:38:37.950602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-ec3fea65-b81f-4d90-b53f-9eab2863505e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] HTTP exception thrown: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ec3fea65-b81f-4d90-b53f-9eab2863505e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Request method failure captured: May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 HTTP/1.1 May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihonUIFnryuozRuklt-DyOKF0cXkVEF8Z0DNCu1OZufbinC6zz-linjxTqGrF0tIHq9HpsuPd9JRSB0TH-JzkihNpwT15wnenp06LthFC4gUAjnZPvHXaaTLmEK1feDnmgc3ptcQnCsNgmAfhsvUgPevTCL38KFo0cloqAV18tHbng May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 37b130e093da409daa4f34baccfc96cd May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesGetTestJSON-1869812720 May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:38:37.958496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37b130e093da409daa4f34baccfc96cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/37b130e093da409daa4f34baccfc96cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/37b130e093da409daa4f34baccfc96cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_37b130e093da409daa4f34baccfc96cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesGetTestJSON-1869812720 May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 37b130e093da409daa4f34baccfc96cd May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesGetTestJSON-1869812720 May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesGetTestJSON-1869812720-project May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: ae50190c609c4e47ba9371410a07d867 May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesGetTestJSON-1869812720-project May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '7e27c4b2-4016-4f48-8345-0d94ae72cc86'} May 31 14:38:37.959634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. (HTTP 404) (Request-ID: req-b683139d-f9c3-4694-ab28-c2ca5acc9a26) May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:37.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 14:38:37.961413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 14:38:37.962355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ec3fea65-b81f-4d90-b53f-9eab2863505e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] Returning 404 to user: Volume 7e27c4b2-4016-4f48-8345-0d94ae72cc86 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ec3fea65-b81f-4d90-b53f-9eab2863505e tempest-VolumesGetTestJSON-1869812720 tempest-VolumesGetTestJSON-1869812720-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86" status: 404 len: 109 microversion: 2.1 time: 0.594166 May 31 14:38:37.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 14/16] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:37 2022] GET /compute/v2.1/os-volumes/7e27c4b2-4016-4f48-8345-0d94ae72cc86 => generated 109 bytes in 596 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:38:38.057208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-64464d05-f7cd-442f-812a-374bda5d6eaf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147899 May 31 14:38:38.058707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 3/17] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:38:38.074141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7f97e5c3-ed39-4947-9b26-27a524f90c2e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:38.075311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7f97e5c3-ed39-4947-9b26-27a524f90c2e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:38.421615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7f97e5c3-ed39-4947-9b26-27a524f90c2e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:38.438387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b4e9d7d-6dbc-4c08-86b9-935abe4fd4d9 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c17ee0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:38.465363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7f97e5c3-ed39-4947-9b26-27a524f90c2e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1215 microversion: 2.1 time: 0.392940 May 31 14:38:38.467815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 15/18] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:38 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:38.547491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b4e9d7d-6dbc-4c08-86b9-935abe4fd4d9 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/c75d23b1-f35b-4306-86b2-8c7072cedba1" status: 200 len: 351 microversion: 2.1 time: 0.113111 May 31 14:38:38.556912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 4/19] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 14:38:38 2022] GET /compute/v2.1/os-volumes/c75d23b1-f35b-4306-86b2-8c7072cedba1 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:38.564774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e43c9c4-47e4-45d8-8287-3d66705a1dd7 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc54ca0d0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:38.813420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e43c9c4-47e4-45d8-8287-3d66705a1dd7 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.256046 May 31 14:38:38.813989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 16/20] 10.222.0.67 () {58 vars in 1133 bytes} [Tue May 31 14:38:38 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:38.828983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8a3431c0-1e5d-4a23-8a54-f1dd2ab4a125 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c179d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:39.171823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8a3431c0-1e5d-4a23-8a54-f1dd2ab4a125 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.348873 May 31 14:38:39.172665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 5/21] 10.222.0.67 () {58 vars in 1148 bytes} [Tue May 31 14:38:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:39.188431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a2e53796-c769-4ec2-8c0a-fbd0b5c933d2 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc54cca60>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:39.427369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a2e53796-c769-4ec2-8c0a-fbd0b5c933d2 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.246722 May 31 14:38:39.429231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 17/22] 10.222.0.67 () {58 vars in 1133 bytes} [Tue May 31 14:38:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:39.442894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2ee993d4-c75a-48cf-8cc7-5f69fc433ef0 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c338b0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:39.485653 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6d6d5e56-a07b-49b1-8e81-a9dffbf6ff24 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:39.486602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6d6d5e56-a07b-49b1-8e81-a9dffbf6ff24 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:39.658607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6d6d5e56-a07b-49b1-8e81-a9dffbf6ff24 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:39.672695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6d6d5e56-a07b-49b1-8e81-a9dffbf6ff24 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1215 microversion: 2.1 time: 0.191977 May 31 14:38:39.676017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 18/23] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:39 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:40.255959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2ee993d4-c75a-48cf-8cc7-5f69fc433ef0 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.817810 May 31 14:38:40.263793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 6/24] 10.222.0.67 () {58 vars in 1166 bytes} [Tue May 31 14:38:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:40.269446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-abaf419d-812d-4163-b7c2-c6844d2639a4 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc55475e0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:40.439897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-abaf419d-812d-4163-b7c2-c6844d2639a4 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173819 May 31 14:38:40.441217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 19/25] 10.222.0.67 () {58 vars in 1169 bytes} [Tue May 31 14:38:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:38:40.462263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-46a51475-3b96-4f00-8180-ccdf500807e5 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c38550>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:40.694444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:40.698175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:40.703306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-46a51475-3b96-4f00-8180-ccdf500807e5 tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.252896 May 31 14:38:40.704229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 7/26] 10.222.0.67 () {58 vars in 1154 bytes} [Tue May 31 14:38:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:40.717558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ed144286-41a3-4425-843d-36411ecb178e tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c179d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:40.721025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:40.721491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:40.722279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:40.722746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:40.918391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ed144286-41a3-4425-843d-36411ecb178e tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.205029 May 31 14:38:40.921011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 8/27] 10.222.0.67 () {58 vars in 1187 bytes} [Tue May 31 14:38:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:38:40.934449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-961d418d-b7f6-4a2b-874f-073d67ec05aa tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] Calling method '.version_select at 0x7f8dc4c380d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:41.099352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:41.136994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c60ab6f9-290f-4125-9680-3276d3d17cd2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1211 microversion: 2.1 time: 0.437398 May 31 14:38:41.137678 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 20/28] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:40 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1211 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:41.159264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-961d418d-b7f6-4a2b-874f-073d67ec05aa tempest-VolumesTestJSON-1465979411 tempest-VolumesTestJSON-1465979411-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.230268 May 31 14:38:41.160299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 9/29] 10.222.0.67 () {58 vars in 1154 bytes} [Tue May 31 14:38:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:38:42.155279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:42.155901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:42.167970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:42.168637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:42.169577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:42.170170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:42.263976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:42.275354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b08007b4-5746-4029-9cda-0b02b72ffd37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1211 microversion: 2.1 time: 0.124488 May 31 14:38:42.276906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 21/30] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:42 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:43.295387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:43.296444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:43.345882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:43.346342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:43.357839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:43.358489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:43.858312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-533111446", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:43.906435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:43.951431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3f646b8e-1344-4b91-b9fd-662bd1b8217d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1211 microversion: 2.1 time: 0.661774 May 31 14:38:43.953609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 10/31] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:43 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1211 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:44.126538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] validate_networks() for [('991fbe80-727a-44d7-bded-1bc6e2dba3d5', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:38:45.304577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ba98137c-85b2-4aa1-a4d1-b685a3d0bb55 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: .version_select at 0x7f8dc43c84c0>, body: {"keypair": {"name": "tempest-keypair-205287452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmRoeUv0Y+jJplwMipv4oLcMPfvPMvDM1vSa6fEn6DaBuObss1kR+tGlqvko1M7Xu2gVmbElTLYRXPatGje55Sr8Oe/0nWC5ggiANEnfn2Hwcwdqxaz6lXI6XPJKebEwA=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:45.360432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-ba98137c-85b2-4aa1-a4d1-b685a3d0bb55 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for project e870af07745948ffa62b2e59eb8054f4. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:38:45.372796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-ba98137c-85b2-4aa1-a4d1-b685a3d0bb55 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for user a36fb9afb5d54d3493e8752bae88dd13 and project e870af07745948ffa62b2e59eb8054f4. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:38:45.457162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ba98137c-85b2-4aa1-a4d1-b685a3d0bb55 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.547501 May 31 14:38:45.471881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 11/32] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 14:38:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:38:45.488473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:45.489448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:45.506462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:45.509040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:45.511750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:45.514773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:45.715075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:45.774432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38ecdd0e-73f8-4c2b-a161-577b5f515853 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1267 microversion: 2.1 time: 0.284799 May 31 14:38:45.776734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 12/33] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:45 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:46.214334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:38:46.215630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:38:46.216266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:38:46.217715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:38:46.218271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:38:46.252325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:46.257226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:46.259015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:46.260797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:46.302272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:38:46.310102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for user 91255c0b2d914ef9be10eb69d7d8ed4f and project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:38:46.333698 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:38:46.338668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:38:46.484240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-819f90fa-a62c-4620-87af-3567fbdba7b0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.900317 May 31 14:38:46.491072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 22/34] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:38:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 14:38:46.496651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8c5ddb69-090e-4df6-8cc4-28aca5c50354 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:46.498125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8c5ddb69-090e-4df6-8cc4-28aca5c50354 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:46.799036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:46.800166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:46.825248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:46.830197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:46.832074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8c5ddb69-090e-4df6-8cc4-28aca5c50354 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:46.832719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:46.834552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:46.882470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8c5ddb69-090e-4df6-8cc4-28aca5c50354 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1221 microversion: 2.1 time: 0.389745 May 31 14:38:46.899142 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 13/35] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:46 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1221 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:47.072718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:47.082022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4ddba134-9112-49a7-b036-908274ad73c0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1275 microversion: 2.1 time: 0.292260 May 31 14:38:47.082607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 23/36] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:46 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:38:47.166309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-458155554", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:47.333125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] validate_networks() for [('991fbe80-727a-44d7-bded-1bc6e2dba3d5', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:38:47.691587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:48.115332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:48.116917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:48.133965 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:48.135236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:48.136283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:48.137054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:48.542014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:48.549947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9cfcd440-4631-4dc3-984c-cee26a274abc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1275 microversion: 2.1 time: 0.450805 May 31 14:38:48.556131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 24/37] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:48 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1275 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:49.000794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:38:49.001603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:38:49.002200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:38:49.002848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:38:49.003457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:38:49.020337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:49.022198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:49.023539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:49.024087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:49.049490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:38:49.054747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for user 91255c0b2d914ef9be10eb69d7d8ed4f and project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:38:49.072077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:38:49.074505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:38:49.150275 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9eb4a5e4-5f4d-4fbf-94a2-6b082294bc5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.990000 May 31 14:38:49.153157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 14/38] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:38:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:38:49.163455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57211f49-f132-4d92-ae2c-437221bbf8a3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:49.164185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-57211f49-f132-4d92-ae2c-437221bbf8a3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:49.389091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-57211f49-f132-4d92-ae2c-437221bbf8a3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:49.396557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-57211f49-f132-4d92-ae2c-437221bbf8a3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1221 microversion: 2.1 time: 0.238775 May 31 14:38:49.399456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 25/39] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:49 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:49.573076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:49.573856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:49.621236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:49.621915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:49.622975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:49.623556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:49.784497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:49.806141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8e76aa98-a8c7-4482-a82a-f1bda64ef6fe tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1275 microversion: 2.1 time: 0.233577 May 31 14:38:49.823441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 15/40] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:49 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:49.868825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-223645153", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ffe9bda-21ad-4de1-b64f-297a27f690d0"}], "security_groups": [{"name": "tempest-securitygroup--473213909"}], "key_name": "tempest-keypair-205287452", "user_data": "}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:38:50.097743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] validate_networks() for [('2ffe9bda-21ad-4de1-b64f-297a27f690d0', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:38:50.416494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:50.418185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:50.426518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:50.427214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:50.429527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:50.430898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:50.795242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:50.806444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0c6ec5fc-a359-4ee2-b623-ec0abfd80e5f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1225 microversion: 2.1 time: 0.394748 May 31 14:38:50.810921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 16/41] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:50 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1225 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:50.825615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:50.826905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:50.852892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:50.865092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:50.866045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:50.866495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:51.139355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:51.145372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:38:51.146437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:38:51.146878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:38:51.147545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:38:51.148161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:38:51.156034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c73fd71e-fe84-4667-a34d-c1c60a303b91 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1273 microversion: 2.1 time: 0.335890 May 31 14:38:51.163714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 17/42] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:50 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:51.170044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:51.171599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:51.173347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:51.174036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:51.223349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for project e870af07745948ffa62b2e59eb8054f4. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:38:51.232892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for user a36fb9afb5d54d3493e8752bae88dd13 and project e870af07745948ffa62b2e59eb8054f4. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:38:51.257650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:38:51.261217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:38:51.347641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3e0acfb4-a4b6-420c-808e-646dd47158f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.484887 May 31 14:38:51.349003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 26/43] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:38:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:38:51.359420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1f53e2f3-d7ba-4f7f-b480-b8bce41c8fa6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:51.360048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1f53e2f3-d7ba-4f7f-b480-b8bce41c8fa6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:51.492218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1f53e2f3-d7ba-4f7f-b480-b8bce41c8fa6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:51.503815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1f53e2f3-d7ba-4f7f-b480-b8bce41c8fa6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1236 microversion: 2.1 time: 0.148242 May 31 14:38:51.516510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 18/44] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:51 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1236 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:51.824082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:51.825347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:51.859749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:51.861617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:51.863460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:51.869580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:52.177233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:52.177858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:52.185814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:52.186267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:52.202919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:52.203462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:52.402714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:52.434285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff9e6ca8-4fb1-40c4-87b5-28dec7106ff8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1291 microversion: 2.1 time: 0.596548 May 31 14:38:52.441362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 27/45] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:51 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1291 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:52.496858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:52.504238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ac422770-2114-445c-997e-2d4328dfccfa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1273 microversion: 2.1 time: 0.330994 May 31 14:38:52.506820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 19/46] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:52 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:38:52.521599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:52.523003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:52.531362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:52.546198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:52.547783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:52.547783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:53.465026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:53.466058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:53.486772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:53.487529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:53.488567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:53.489174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:53.570430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:53.601587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ffefe2d1-8a1d-492c-b7a2-73bce0336955 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1240 microversion: 2.1 time: 1.081436 May 31 14:38:53.603756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 28/47] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:52 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1240 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:53.631239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:53.633878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:53.671774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:53.673382 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:53.682140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:53.684117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:53.865511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:53.878433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-311d8ca3-3727-4846-b95d-e42486193a9e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1279 microversion: 2.1 time: 0.424971 May 31 14:38:53.879125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 20/48] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:53 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1279 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:38:54.525093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:54.533941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f1ee0c04-949f-4d6e-a566-9a366375cd6b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.926437 May 31 14:38:54.548811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 29/49] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:53 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:54.620234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:54.624050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:54.638778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:54.645769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:54.647263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:54.647989 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:54.896808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:54.897649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:54.935267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:54.935955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:54.946020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:54.946774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:55.245032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:55.255930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f45de11f-7fe6-49dd-9a05-65c152e47ec5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1294 microversion: 2.1 time: 0.639468 May 31 14:38:55.258276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 21/50] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:54 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1294 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:55.346201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:55.358464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f9c41198-0df7-4db4-b0d2-d079f6fe334d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1279 microversion: 2.1 time: 0.465984 May 31 14:38:55.359149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 30/51] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:54 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1279 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:55.552880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:55.553757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:55.563801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:55.569365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:55.573477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:55.579576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:55.944485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:55.977980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8011c380-b60f-4da4-bebc-667dc356510a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.421319 May 31 14:38:55.993498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 22/52] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:55 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:56.284256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:56.286805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:56.308984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:56.310713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:56.315571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:56.317557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:56.381705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:56.383049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:56.397768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:56.404883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:56.406122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:56.411936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:56.532969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:56.555718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4b9975ed-7efb-4ad2-ad0a-b7026fecf6ff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1294 microversion: 2.1 time: 0.277956 May 31 14:38:56.557529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 31/53] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:56 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1294 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:57.003670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:57.004720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:57.020873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:57.022538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:57.023691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:57.026103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:57.670140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:57.679108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8f6949e4-4551-4da1-88dd-96738999971a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.681184 May 31 14:38:57.690985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 32/54] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:56 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:57.696831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:57.697456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:57.708585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:57.718377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:57.719298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:57.720365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:57.725706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:57.747468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-95b88772-63df-4f7c-940f-365078f30c9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 1.372567 May 31 14:38:57.767923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 23/55] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:56 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:38:57.905859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:57.922233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-316e6089-6281-42a9-971a-4f249064f572 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1294 microversion: 2.1 time: 0.229842 May 31 14:38:57.933209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 33/56] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:57 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:58.702432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:58.703741 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:58.713758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:58.716316 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:58.717901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:58.719752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:58.777352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:58.778513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:58.792408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:58.800259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:58.802173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:58.804415 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:59.038064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:38:59.471104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:59.480931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2b106272-5d20-4136-a555-5166566011ab tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.709221 May 31 14:38:59.484160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 34/57] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:58 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:38:59.499302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:38:59.500134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:38:59.515129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:59.515614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:59.517310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:38:59.517759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:38:59.522904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:38:59.533929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c278673e-22f4-4723-8e44-690b360e3d64 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.836227 May 31 14:38:59.541635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 24/58] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:58 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:00.377964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:00.393910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-68674010-1c85-4bed-b8c6-fdc0d0bbcf9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.907057 May 31 14:39:00.398709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 35/59] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:38:59 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:00.505368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:00.509266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:00.529934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:00.534021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:00.536966 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:00.539713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:00.551904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:00.552850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:00.573021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:00.574483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:00.577048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:00.593700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:01.194684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:01.251391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=18 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:01.501990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=20 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:01.740127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:01.768974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-57ed311b-12ee-4169-8b24-0ad3b9c406cd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 1.269931 May 31 14:39:01.774312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:01.786465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-77db7bd4-833a-41f5-b089-a31d147dee06 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 1.238787 May 31 14:39:01.788066 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 25/60] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:00 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:01.791333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 36/61] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:00 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:01.806324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:01.810916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:01.826280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:01.827031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:01.829571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:01.832829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.255626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:02.270600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4f78ad14-7c34-4a3f-a18d-73313afab886 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.477962 May 31 14:39:02.284441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 37/62] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:01 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:02.430937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-76972e33-5271-42c2-a6dc-63d7ee712ef6 req-5f7d7355-050c-4365-9726-ce284822a7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22678417-12d6-42bd-a369-7ebe301adeb1", "tag": "cab65840-02e9-4e84-b48b-0355060c9c09"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:02.460210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-76972e33-5271-42c2-a6dc-63d7ee712ef6 req-5f7d7355-050c-4365-9726-ce284822a7ee service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.463252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-76972e33-5271-42c2-a6dc-63d7ee712ef6 req-5f7d7355-050c-4365-9726-ce284822a7ee service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.528291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=78 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:02.554896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-76972e33-5271-42c2-a6dc-63d7ee712ef6 req-5f7d7355-050c-4365-9726-ce284822a7ee service nova] Creating event network-changed:cab65840-02e9-4e84-b48b-0355060c9c09 for instance 22678417-12d6-42bd-a369-7ebe301adeb1 on hv-cinder-83979 May 31 14:39:02.556210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-76972e33-5271-42c2-a6dc-63d7ee712ef6 req-5f7d7355-050c-4365-9726-ce284822a7ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=124107) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 14:39:02.558854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.559474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.560519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.561310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.582362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.compute.rpcapi [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 14:39:02.584591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] Releasing lock "compute-rpcapi-router" {{(pid=124107) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 14:39:02.631465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3ee3bcb1-85e9-4414-a844-6e83dbd1b007 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.841704 May 31 14:39:02.632583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 26/63] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:02.806250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:02.807059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:02.809219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:02.809747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:02.811590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:02.823529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.832465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:02.837198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.838252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.839930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.852119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.853525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.855833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:02.858843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:02.888254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=95 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:03.962625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:03.964906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:03.973299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-95838ef4-349c-4802-a26f-5fd581dc14cc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 1.174514 May 31 14:39:03.975681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-11d72c6c-68e9-4e10-99f6-1de4ef908205 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 1.172224 May 31 14:39:03.985433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 38/64] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:02 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:03.985615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 27/65] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:02 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:03.989342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:03.990277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:04.009749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:04.010473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:04.011436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:04.012041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:04.198160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:04.206780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-47290b95-0619-48e6-96d6-282b7322e07f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.228573 May 31 14:39:04.208263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 39/66] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:03 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:04.308368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-4454ed11-dd1b-44be-ac58-5644238eb579 req-28549d55-a616-4aac-9777-a57e51605d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80e99d1-9423-47b2-b602-c03b9019dc96", "tag": "53136f2b-686f-451a-acf2-3801c8829f82"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:04.317817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4454ed11-dd1b-44be-ac58-5644238eb579 req-28549d55-a616-4aac-9777-a57e51605d9d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:04.318395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4454ed11-dd1b-44be-ac58-5644238eb579 req-28549d55-a616-4aac-9777-a57e51605d9d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:04.333497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-4454ed11-dd1b-44be-ac58-5644238eb579 req-28549d55-a616-4aac-9777-a57e51605d9d service nova] Creating event network-changed:53136f2b-686f-451a-acf2-3801c8829f82 for instance c80e99d1-9423-47b2-b602-c03b9019dc96 on hv-cinder-83979 May 31 14:39:04.339636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-4454ed11-dd1b-44be-ac58-5644238eb579 req-28549d55-a616-4aac-9777-a57e51605d9d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358548 May 31 14:39:04.340443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 28/67] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:05.006800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:05.009607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:05.012847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:05.014281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:05.023134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.023588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.025245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.025693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.026451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.027608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.028033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.029420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.282827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:05.286806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:05.295546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3d1d71dc-c760-4d70-8dbf-3193f2f86bd7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.302515 May 31 14:39:05.296452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 40/68] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:04 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:05.303365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:05.303984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:05.310823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e1d2e0a4-9225-47d5-b063-6710b8da25fd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.317752 May 31 14:39:05.311007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.311368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.312383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:05.312508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 29/69] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:04 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:05.313605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:05.482279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:05.489690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b231aecd-ece6-435e-b194-ad8637080715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.192194 May 31 14:39:05.490260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 41/70] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:05 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:06.313762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:06.314683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:06.327637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.328278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.329253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.329480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:06.329969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.334263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:06.345524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.346098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.351279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.352224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.636949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:06.644386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4168332e-64e9-4582-8936-d37db932c16e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.335265 May 31 14:39:06.656234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 30/71] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:06 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:06.662127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b82b1e9-fc5f-4b2a-8664-7f322485f0b0", "tag": "3f4f5385-3fde-43ed-9d4d-9d7f4928cc90"}, {"name": "network-changed", "server_uuid": "d93b6401-2207-4636-98d0-f2e324cc2879", "tag": "2fb762bf-8969-45fa-a3d0-4f9152e89178"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:06.687889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.688562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.715441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] Creating event network-changed:3f4f5385-3fde-43ed-9d4d-9d7f4928cc90 for instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 on hv-cinder-83979 May 31 14:39:06.715956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] Creating event network-changed:2fb762bf-8969-45fa-a3d0-4f9152e89178 for instance d93b6401-2207-4636-98d0-f2e324cc2879 on hv-cinder-83979 May 31 14:39:06.725365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-6cf98819-2257-4a1e-b2f2-58e501cb7a7c req-b57858dc-ec00-4861-839c-198e6414c17a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067628 May 31 14:39:06.726535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 31/72] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:06.732894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:06.733877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:06.741152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.742380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.743388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:06.744002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:06.815405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:06.828242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7fcd6b11-1f23-4bef-a1a6-4cf27b5c0168 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.503066 May 31 14:39:06.839445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 42/73] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:06 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:06.996249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:07.004572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2da7a3e9-c788-4819-8c1b-583aff705f47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.276273 May 31 14:39:07.005334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 32/74] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:06 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:07.670958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:07.671927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:07.682585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:07.684150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:07.685850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:07.687288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:07.864245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:07.866087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:07.880017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:07.880998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:07.882096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:07.883342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:07.905961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:07.921237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a8ea0400-9297-4742-a4a1-2860cca8975c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.262524 May 31 14:39:07.933592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 43/75] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:07 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:08.022122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:08.022744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:08.032114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:08.032782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:08.033815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:08.034392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:08.075146 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:08.083661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4138a0ee-5a4e-4120-9684-78a9bbb87449 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.241668 May 31 14:39:08.084616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 33/76] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:07 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:08.216262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:08.225354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0364a966-5fb5-4333-97ac-f292c30a0052 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.207128 May 31 14:39:08.231336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 44/77] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:08 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:08.940654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:08.941260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:08.948444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:08.949088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:08.949858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:08.950295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:09.101373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:09.102533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:09.109461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:09.109921 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:09.111278 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:09.111278 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:09.203425 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:09.212947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4f550f0e-38ac-4750-8712-1714787ec3cf tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.276003 May 31 14:39:09.213862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 34/78] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:08 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:09.246127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:09.247127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:09.256224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:09.256918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:09.258923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:09.259368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:09.386742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:09.396046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a933d77c-9c94-405a-8a07-4fc9059c1fdf tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.298172 May 31 14:39:09.397213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 45/79] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:09 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:09.438540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:09.448272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-76802997-faeb-4f64-8a20-3fbe23612720 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.208445 May 31 14:39:09.449004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 35/80] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:09 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:10.232172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:10.232940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:10.240049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.240870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.242248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.242923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.407690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:10.418445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:10.419100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:10.432473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4bb357fa-fe9a-4e5e-b475-b913a9a82402 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.205935 May 31 14:39:10.433057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 46/81] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:10 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:10.435761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.436222 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.437001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.437441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.465778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:10.466565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:10.474957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.475773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.477245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:10.477830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:10.658335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:10.667821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-85b1dd40-0c72-4a18-8329-84919549f4cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.258362 May 31 14:39:10.668725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 36/82] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:10 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:10.684623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:10.692423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff91f992-bad4-417b-b98c-89db08910c79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.231793 May 31 14:39:10.692981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 47/83] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:10 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:11.449451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:11.450074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:11.462053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.462900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.463687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.464126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.603540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:11.610902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-65332a40-ff77-4dac-a7b8-65ddbaa268dd tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.165366 May 31 14:39:11.611452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 37/84] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:11 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:11.685376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:11.686082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:11.693969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.694454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.695266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.695704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.708601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:11.709210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:11.715811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.716257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.717071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:11.717672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:11.903854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:11.908011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:11.915321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-281972d1-59ac-4f75-97f7-b40686f3a88b tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.233520 May 31 14:39:11.916285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 48/85] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:11 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:11.916638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-47768450-14f4-4263-b8cd-e0a2edcb519d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.211809 May 31 14:39:11.929897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 38/86] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:11 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:12.627936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:12.628552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:12.636528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.636983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:12.637746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.638184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:12.848015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:12.858385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-967b0627-7adf-4c1c-991f-e95219b21c09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.234205 May 31 14:39:12.859262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 49/87] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:12 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:12.942258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:12.945938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:12.946719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:12.947136 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:12.952121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:12.957401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.958154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:12.960014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.961176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:12.962946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.963409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:12.965114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:12.965663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:13.171664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:13.178934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1305a52-d0ac-427c-8e6a-164c1adeb238 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.242799 May 31 14:39:13.179942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 50/88] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:12 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:13.199319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:13.206619 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d84f2e5c-793f-4844-8289-8ce2ed2b0a8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.268970 May 31 14:39:13.207592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 39/89] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:12 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:13.878089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:13.878766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:13.889260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:13.889686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:13.892978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:13.895886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:14.092145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:14.106456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bdff4f91-decc-4e58-aa15-ec737ea94685 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.232894 May 31 14:39:14.116112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 51/90] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:13 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:14.198866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:14.199710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:14.208156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:14.208611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:14.209411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:14.209843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:14.225420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:14.227280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:14.235862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:14.236381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:14.237520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:14.238128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:14.481502 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:14.487058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:14.494976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1fb820bc-8b91-430a-a15a-26e89928dc2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.274884 May 31 14:39:14.495842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2680ff1d-cee0-4508-9a62-dfba02991631 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.301121 May 31 14:39:14.496202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 52/91] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:14 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:14.496388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 40/92] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:14 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:15.123261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:15.124841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:15.132984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.133434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.134215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.134753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.267276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:15.278574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ebfaf01f-0664-4b97-8049-92241e70eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.159208 May 31 14:39:15.279380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 53/93] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:15 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:15.513894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:15.515830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:15.518565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:15.519213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:15.524000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.524498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.527604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.528056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.531078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.531078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.531078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:15.531078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:15.758545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:15.762763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:15.766113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:15.766735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e8c3bb50-6c8d-4cfb-bb55-8df808d8a8d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.257035 May 31 14:39:15.767600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 41/94] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:15 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:15.772731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-90e867a1-aea7-4eb5-8395-fb9450701dbc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.257890 May 31 14:39:15.773375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 54/95] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:15 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:16.295753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:16.296506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:16.303441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.303817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:16.304572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.305008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:16.453297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:16.461816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-92e19d78-d225-4290-bdbe-8926373f4625 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.169844 May 31 14:39:16.462401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 42/96] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:16 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:16.784811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:16.785423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:16.791239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:16.792614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:16.792739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.793270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:16.794216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.794834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:16.806891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.809024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:16.811198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:16.812931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:17.002631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:17.008102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:17.010886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3cdc9247-e401-4d99-834a-433dcbb116f9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.230078 May 31 14:39:17.011462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 55/97] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:16 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:17.015172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-71fac86c-7917-47ed-91ad-a6fe1bbda197 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.227715 May 31 14:39:17.015726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 43/98] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:16 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:17.479205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:17.479814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:17.485723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:17.486170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:17.486956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:17.487386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:17.616136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:17.623525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-33efac06-dc9c-43fd-aa35-2edff12506c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.148865 May 31 14:39:17.624085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 56/99] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:17 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:18.028792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:18.029596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:18.031761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:18.032126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:18.036421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.037255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.038138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.038731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.040140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.040597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.041375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.041819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.059480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:18.238264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:18.243104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:18.253844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-500892c9-2eae-42d0-bd39-e16e7d66255c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.229320 May 31 14:39:18.254424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 44/100] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:18 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:18.256716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f5cb8dc8-f669-4abc-96c4-1714e88a5b83 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.228929 May 31 14:39:18.257317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 57/101] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:18 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:18.640224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:18.640838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:18.646871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.647326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.648089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:18.648524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:18.777218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:18.784468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d94a1bff-4728-415a-9ac9-946661750092 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.148115 May 31 14:39:18.785029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 45/102] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:18 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:19.271017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:19.271548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:19.274457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:19.275518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:19.278227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.278691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.279447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.279874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.281054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.281522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.282259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.282714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.472815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:19.475995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:19.480449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d1c758fc-680c-4182-b879-a72ae0f5e0f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.213555 May 31 14:39:19.481108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 58/103] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:19 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:19.483266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4747788a-88e0-4b3c-9c4d-d96ecbfe6fc4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.213115 May 31 14:39:19.483817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 46/104] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:19 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:19.800831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:19.801360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:19.807810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.808260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.809011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:19.809446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:19.936942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:19.944576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bba79a13-ab80-47ff-8822-10e20403af2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.147598 May 31 14:39:19.945208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 59/105] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:19 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:20.497179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:20.497902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:20.499755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:20.500364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:20.503882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.504329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:20.505073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.505504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:20.506166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.506620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:20.507395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.507832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:20.696279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:20.700270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:20.703756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-72198a88-3f7c-45e1-a282-8805468efeab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.210426 May 31 14:39:20.704331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 47/106] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:20 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:20.707803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-58c6bfd8-4ff0-47c1-92f5-c7af06da5d33 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.211845 May 31 14:39:20.708354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 60/107] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:20 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:20.962382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:20.962920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:20.969174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.969616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:20.970356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:20.970824 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:21.103503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:21.110806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-597a0418-ae74-4797-8c7f-47ab1471025d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.152897 May 31 14:39:21.111401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 48/108] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:20 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:21.721174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:21.721888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:21.724865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:21.725476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:21.728778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:21.729302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:21.730131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:21.730621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:21.732769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:21.733223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:21.733978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:21.734411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:22.090175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:22.098852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0c8ac1c0-0ebb-4456-9dfe-2d9b8a8427da tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.381653 May 31 14:39:22.099614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 61/109] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:21 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:22.107634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:22.116387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-303c833f-58db-4b33-9053-c6ddd558f358 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.395218 May 31 14:39:22.116931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 49/110] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:21 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:22.130459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:22.131228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:22.137886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:22.138594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:22.139422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:22.139867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:22.264902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:22.272270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-94169bce-fcc5-46a7-8e74-df97cdb2d375 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.146146 May 31 14:39:22.272841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 62/111] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:22 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:22.901776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-ed513c35-2f36-43d2-9213-7503db2e05c2 req-c697f10f-d7e4-4814-9950-9c61723cee9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22678417-12d6-42bd-a369-7ebe301adeb1", "name": "network-vif-plugged", "status": "completed", "tag": "cab65840-02e9-4e84-b48b-0355060c9c09"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:22.910668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-ed513c35-2f36-43d2-9213-7503db2e05c2 req-c697f10f-d7e4-4814-9950-9c61723cee9a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:22.911176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-ed513c35-2f36-43d2-9213-7503db2e05c2 req-c697f10f-d7e4-4814-9950-9c61723cee9a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:22.922895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-ed513c35-2f36-43d2-9213-7503db2e05c2 req-c697f10f-d7e4-4814-9950-9c61723cee9a service nova] Creating event network-vif-plugged:cab65840-02e9-4e84-b48b-0355060c9c09 for instance 22678417-12d6-42bd-a369-7ebe301adeb1 on hv-cinder-83979 May 31 14:39:22.927872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-ed513c35-2f36-43d2-9213-7503db2e05c2 req-c697f10f-d7e4-4814-9950-9c61723cee9a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083993 May 31 14:39:22.928477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 50/112] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:23.117211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:23.118005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:23.127218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.127901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.129060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.129715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.134376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:23.134628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:23.142025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.142431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.143322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.144811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.399660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:23.405224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:23.406689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c36f43a5-fe11-47ae-97ac-26de516bc549 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.277913 May 31 14:39:23.407570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 51/113] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:23 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:23.411948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:23.412548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:23.413607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c9fb1ce9-ded9-4b90-b724-0f83cd1b9630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.301042 May 31 14:39:23.414928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 63/114] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:23 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:23.418667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.419115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.420139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:23.420300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:23.596951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:23.606289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-12009180-6d18-42d4-8801-3b6dffbec08e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.197659 May 31 14:39:23.607542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 52/115] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:23 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:24.432365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:24.432976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:24.433571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:24.434262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:24.440312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.440772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.441531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.441851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.442306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.442424 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.443099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.443691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.656835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:24.665965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:24.667849 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d617d18e-b588-452b-937f-3ca9d58fe741 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.239694 May 31 14:39:24.674076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c90e10d4-af9a-4eaa-b8ac-0a827f975e13 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.245750 May 31 14:39:24.677658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 64/116] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:24 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:24.683555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:24.684398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:24.684537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 53/117] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:24 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:24.691327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.691948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.692901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:24.693333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:24.898470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:24.907261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-31596a9f-d524-48d6-be1f-9249e923e73c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.228238 May 31 14:39:24.908108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 65/118] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:24 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:25.684730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:25.685884 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:25.692371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.693074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:25.694025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.694469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:25.695112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:25.695916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:25.704870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.705588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:25.706766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.707720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:25.902041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:25.909019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:25.916441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c6150444-30b3-404a-b478-31af97398272 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.234802 May 31 14:39:25.917026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 54/119] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:25 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:25.918000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ac2193eb-c984-4f7f-9857-636573415587 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.230145 May 31 14:39:25.918488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 66/120] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:25 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:25.924894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:25.926027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:25.932244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.932695 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:25.933452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:25.933891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:26.071188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:26.079980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5770ac13-1ac2-411f-9d4c-21a1fd74ff52 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.159411 May 31 14:39:26.080553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 55/121] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:25 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:26.882284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-651f70ad-8ce4-4a64-902a-a02d6fa19e8b req-e520c772-e2cf-4cdd-9f61-2cec2ef6758a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b82b1e9-fc5f-4b2a-8664-7f322485f0b0", "name": "network-vif-plugged", "status": "completed", "tag": "3f4f5385-3fde-43ed-9d4d-9d7f4928cc90"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:26.909848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-651f70ad-8ce4-4a64-902a-a02d6fa19e8b req-e520c772-e2cf-4cdd-9f61-2cec2ef6758a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:26.910300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-651f70ad-8ce4-4a64-902a-a02d6fa19e8b req-e520c772-e2cf-4cdd-9f61-2cec2ef6758a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:26.935185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:26.936608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:26.944930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:26.945657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:26.946892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:26.947537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.149330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-651f70ad-8ce4-4a64-902a-a02d6fa19e8b req-e520c772-e2cf-4cdd-9f61-2cec2ef6758a service nova] Creating event network-vif-plugged:3f4f5385-3fde-43ed-9d4d-9d7f4928cc90 for instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 on hv-cinder-83979 May 31 14:39:27.150773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-651f70ad-8ce4-4a64-902a-a02d6fa19e8b req-e520c772-e2cf-4cdd-9f61-2cec2ef6758a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 14:39:27.152834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.153577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.154886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.155604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.173434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:27.179047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.compute.rpcapi [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 14:39:27.180479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] Releasing lock "compute-rpcapi-router" {{(pid=124106) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 14:39:27.188780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-19b52a0e-38fb-48c2-9d43-0ef7cb5289a8 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.256018 May 31 14:39:27.189685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 56/122] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:26 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:27.195831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:27.196450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:27.202500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.203065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.203733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.204335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.214940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fc2e2b12-be03-43ea-baca-af5ba7e0b40a None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336886 May 31 14:39:27.215543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 67/123] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:27.233744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:27.239769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:27.249759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.250310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.251526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:27.252103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:27.475131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:27.483449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-30ec367b-71f4-45de-996d-61d312da071b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.255211 May 31 14:39:27.486821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 68/124] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:27 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:27.558463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:27.568230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ca7833c6-159f-44fa-9181-0b83c6a2a284 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.375575 May 31 14:39:27.568703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 57/125] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:27 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:28.206138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:28.206851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:28.214599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.215088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.215863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.216318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.370586 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:28.379245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4ac597d7-5fc2-4047-b2c8-5c2e890c5116 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.177181 May 31 14:39:28.379848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 69/126] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:28 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:28.506803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:28.507516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:28.514288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.514859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.516756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.517325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.585096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:28.585710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:28.593194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.593723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.594886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:28.595348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:28.735813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:28.744686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-adfed3bc-818b-4a49-8793-598058bed349 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.242906 May 31 14:39:28.745831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 58/127] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:28 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:28.771381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:28.778604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e91c6a39-16b5-4fcd-9465-0404fe35fcac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.197284 May 31 14:39:28.779206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 70/128] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:28 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:29.395851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:29.396462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:29.402477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.402978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.403742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.404183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.539484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:29.550274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6aeb2841-09b4-4d6a-b413-1992c82dab75 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.158188 May 31 14:39:29.551244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 59/129] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:29 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:29.761402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:29.762245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:29.768421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.768982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.769969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.770403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.796259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:29.797158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:29.804636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.805833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.807693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:29.808360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:29.976430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:29.978876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:29.988566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5c21d312-ef01-4771-9276-603213794666 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.230895 May 31 14:39:29.994941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 71/130] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:29 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:30.029621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:30.037278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5d6b5468-1b70-40b5-9e0d-e00fc934c305 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.244891 May 31 14:39:30.037856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 60/131] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:29 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:30.568051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:30.568671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:30.574833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:30.575447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:30.576594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:30.577041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:30.726123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:30.735981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-37e19b62-618b-469f-8466-cc3c8bfe50b0 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.172436 May 31 14:39:30.736558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 72/132] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:30 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:31.009281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:31.009987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:31.016155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.016617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.017391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.017858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.054548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:31.056922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:31.064125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.065082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.066147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.066871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.284842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:31.288355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:31.293625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:31.293801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ea536c3b-4cbc-4c26-a5b9-5b2370458e1a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.288366 May 31 14:39:31.294325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 61/133] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:31 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:31.301411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2db52201-f561-471b-8d22-7c1b17712aae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.250679 May 31 14:39:31.302907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 73/134] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:31 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:31.754269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:31.754918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:31.767270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.767652 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.769246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:31.769873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:31.906808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:31.913994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-484c4169-46e8-45b5-8b4f-1ddf29d2808c tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.164480 May 31 14:39:31.914554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 62/135] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:31 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:32.311947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:32.317987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:32.318746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:32.319620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:32.330542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.332311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.333140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:32.334304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.334700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:32.335530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.336116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:32.336691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:32.572148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:32.576609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:32.585182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-89658824-27b8-4ed2-ab8d-a3f7125c2ca6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.271182 May 31 14:39:32.585397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ab0a9dab-661c-4e74-adc5-d1fe7eaaa23b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.276394 May 31 14:39:32.597032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 74/136] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:32 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:32.598319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 63/137] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:32 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:32.931772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:32.932767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:32.939043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=74 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:32.942757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.943790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:32.944948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:32.946023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:33.234826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:33.247097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8e64210e-e675-4772-81ec-6f871eaa97bc tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.319932 May 31 14:39:33.248032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 75/138] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:32 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:33.609286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:33.612922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:33.614417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:33.615967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:33.631705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=74 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:33.634889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:33.635512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:33.635998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:33.636612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:33.637545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:33.638457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:33.639078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:33.639667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:33.905989 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:33.913432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5e438818-73bc-4c0f-8988-3c4d5ab4f9a1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.314387 May 31 14:39:33.923791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 64/139] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:33 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:33.926615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:33.935460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-42647d3a-6d6f-4a68-84df-70f71d518699 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.332517 May 31 14:39:33.936039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 76/140] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:33 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:34.266087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:34.266890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:34.277590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.278372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:34.279415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.280108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:34.455095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:34.465929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b7bbc284-f5df-43c1-8627-74a4567a0b21 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.204139 May 31 14:39:34.466771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 65/141] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:34 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:34.934187 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:34.937157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:34.959700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:34.961067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:34.968607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.969061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:34.969851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.970288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:34.979246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.980139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:34.983184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:34.984043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:35.371044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:35.385166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-da307411-367a-4644-a54a-7580c4316780 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.430709 May 31 14:39:35.386047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 66/142] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:34 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:35.403940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-4269bf3b-b5e9-41b3-9716-a64da6ebd649 req-68737267-b793-435c-a29c-fa40ad99662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80e99d1-9423-47b2-b602-c03b9019dc96", "name": "network-vif-plugged", "status": "completed", "tag": "53136f2b-686f-451a-acf2-3801c8829f82"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:35.404139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:35.416007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4269bf3b-b5e9-41b3-9716-a64da6ebd649 req-68737267-b793-435c-a29c-fa40ad99662e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:35.416680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4269bf3b-b5e9-41b3-9716-a64da6ebd649 req-68737267-b793-435c-a29c-fa40ad99662e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:35.432863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-4269bf3b-b5e9-41b3-9716-a64da6ebd649 req-68737267-b793-435c-a29c-fa40ad99662e service nova] Creating event network-vif-plugged:53136f2b-686f-451a-acf2-3801c8829f82 for instance c80e99d1-9423-47b2-b602-c03b9019dc96 on hv-cinder-83979 May 31 14:39:35.438141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1e966bf3-2dd9-4b10-b606-097befda8f5e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1321 microversion: 2.1 time: 0.510971 May 31 14:39:35.440073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-4269bf3b-b5e9-41b3-9716-a64da6ebd649 req-68737267-b793-435c-a29c-fa40ad99662e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 May 31 14:39:35.441203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 67/143] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:35.443431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 77/144] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:34 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:35.492847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:35.493714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:35.506754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:35.507227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:35.510289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:35.511079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:35.742306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:35.751208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9e03e0b9-ac53-45b7-b9af-ed2ef51565fa tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1315 microversion: 2.1 time: 0.265232 May 31 14:39:35.751832 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 68/145] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:35 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:36.401732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:36.402347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:36.408401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.408847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.413557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.413557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.459862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:36.460501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:36.472325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.472325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.472325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.472325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.616190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:36.628122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d9add40c-9195-478c-809c-8f888f9525cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.230261 May 31 14:39:36.628704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 78/146] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:36 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:36.685536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:36.694589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5eea1b49-5820-40a4-bede-8c0681abb7d2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1516 microversion: 2.1 time: 0.238860 May 31 14:39:36.695374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 69/147] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:36 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:36.715112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:36.716286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:36.723024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.723634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.724884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.725466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.768476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:36.769102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:36.776151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.776773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.777549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:36.777978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:36.825327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lazy-loading 'flavor' on Instance uuid 22678417-12d6-42bd-a369-7ebe301adeb1 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:39:36.980231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:36.985573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cc613b6c-2f42-49b2-b858-30d20909af8d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1/action" status: 200 len: 32 microversion: 2.1 time: 0.276834 May 31 14:39:36.986249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 79/148] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:39:36 2022] POST /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 14:39:36.992421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ee0abf28-b8dd-4628-8cdc-68456aa4b34d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1502 microversion: 2.1 time: 0.227429 May 31 14:39:36.995589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 70/149] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:36 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:36.998670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:36.999375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:37.015046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:37.015626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:37.016569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:37.017070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:37.177338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:37.209808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:37.221314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f12841e5-ad34-4929-bdd3-b60583df5d6f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.226781 May 31 14:39:37.221936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 80/150] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:36 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:37.458447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-e85699a6-eca1-45f2-804c-9f968e9c2d39 req-fced25a1-3289-47d2-bd79-58f34ee132e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93b6401-2207-4636-98d0-f2e324cc2879", "name": "network-vif-plugged", "status": "completed", "tag": "2fb762bf-8969-45fa-a3d0-4f9152e89178"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:37.467982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-e85699a6-eca1-45f2-804c-9f968e9c2d39 req-fced25a1-3289-47d2-bd79-58f34ee132e0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:37.468626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-e85699a6-eca1-45f2-804c-9f968e9c2d39 req-fced25a1-3289-47d2-bd79-58f34ee132e0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:37.481490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-e85699a6-eca1-45f2-804c-9f968e9c2d39 req-fced25a1-3289-47d2-bd79-58f34ee132e0 service nova] Creating event network-vif-plugged:2fb762bf-8969-45fa-a3d0-4f9152e89178 for instance d93b6401-2207-4636-98d0-f2e324cc2879 on hv-cinder-83979 May 31 14:39:37.490381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-e85699a6-eca1-45f2-804c-9f968e9c2d39 req-fced25a1-3289-47d2-bd79-58f34ee132e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 May 31 14:39:37.494778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 71/151] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:39:37.648071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:37.648831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:37.659029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:37.659478 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:37.660246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:37.660682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:37.819375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:37.828149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f152f239-40d4-413e-88bf-f694ec6fc16e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.184609 May 31 14:39:37.829578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 81/152] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:37 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:38.241880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:38.243099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:38.250925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.251462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:38.252297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.252834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:38.455645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:38.464296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-73493b5f-62d6-42cc-8be2-ed3212a4753d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.227397 May 31 14:39:38.465023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 72/153] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:38 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:38.611531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe25a587-fa73-400d-91b4-9f6293107be2"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:38.612679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:38.626180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.626637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:38.627442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.627884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:38.848621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:38.850430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:38.864647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.865955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:38.867489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:38.871655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:39.037786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:39.046536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-68f6b5a0-8b6e-47e1-b5c9-a71992a2dfd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1361 microversion: 2.1 time: 0.204922 May 31 14:39:39.047712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 73/154] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:38 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:39.481881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:39.482491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:39.489189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:39.489650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:39.490422 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:39.490911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:39.750080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:39.768938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-102aea0e-d7a1-44dd-a441-e9a96acb70d8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.290123 May 31 14:39:39.769559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 74/155] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:39 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:40.063608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:40.065324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:40.072780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.073638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:40.074630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.075373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:40.269794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:40.276507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d8caedc7-bce5-4539-abb7-2b1a5e129413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1547 microversion: 2.1 time: 0.216718 May 31 14:39:40.277084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 75/156] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:40 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:40.300217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:40.300860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:40.308446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.309498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:40.310518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.311188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:40.469912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-69016904-bd83-4ecc-81fd-6246614369ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174444 May 31 14:39:40.470837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 76/157] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 14:39:40 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:40.671342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c212a7da-d3b8-4512-88e0-4b2685447ec4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "POST /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.063958 May 31 14:39:40.672221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 82/158] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:39:38 2022] POST /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0/os-volume_attachments => generated 194 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:40.789300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:40.790210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:40.797380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.798150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:40.799190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:40.799988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:41.085430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:41.096309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3ef0ccc3-a5b1-482c-a85c-16ac7b2f3afa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.314452 May 31 14:39:41.107351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 77/159] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:40 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:42.114795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:42.115502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:42.154506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:42.158025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:42.161799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:42.162265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:42.465687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:42.474426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e98ad246-2782-4710-9f1e-bc9d1220f4df tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.364670 May 31 14:39:42.475855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 83/160] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:42 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:43.332348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-fdda808b-7c20-4213-a1dc-de597947164c req-543e97eb-aef1-4c4c-8194-6be528e43340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80e99d1-9423-47b2-b602-c03b9019dc96", "tag": "53136f2b-686f-451a-acf2-3801c8829f82"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:43.340807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-fdda808b-7c20-4213-a1dc-de597947164c req-543e97eb-aef1-4c4c-8194-6be528e43340 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:43.341530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-fdda808b-7c20-4213-a1dc-de597947164c req-543e97eb-aef1-4c4c-8194-6be528e43340 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:43.354852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-fdda808b-7c20-4213-a1dc-de597947164c req-543e97eb-aef1-4c4c-8194-6be528e43340 service nova] Creating event network-changed:53136f2b-686f-451a-acf2-3801c8829f82 for instance c80e99d1-9423-47b2-b602-c03b9019dc96 on hv-cinder-83979 May 31 14:39:43.360254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-fdda808b-7c20-4213-a1dc-de597947164c req-543e97eb-aef1-4c4c-8194-6be528e43340 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031617 May 31 14:39:43.361156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 78/161] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:43.495422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:43.496031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:43.522545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:43.523107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:43.523926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:43.524401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:44.030261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:44.038952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ce3cdf83-4d5b-4c29-bc7b-82419204faf3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.549293 May 31 14:39:44.040236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 84/162] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:43 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:45.057435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:45.058469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:45.075281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:45.076023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:45.079086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:45.079640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:45.456836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:45.465607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b935dcec-df9a-4f50-a9e4-534b89726e89 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.413816 May 31 14:39:45.466393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 79/163] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:45 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:46.487144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:46.488009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:46.495804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:46.496265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:46.497046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:46.497681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:46.506678 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:46.687255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:46.697258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b66e131a-b47c-44a5-b64b-97b6948cfec9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.213892 May 31 14:39:46.698236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 85/164] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:46 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:47.722213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:47.722935 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:47.732955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:47.738784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:47.739745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:47.740223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:47.967902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:47.983620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:39:47.994164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8c06c085-38d1-4608-b5c3-fa99b6cb1bb6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.276463 May 31 14:39:47.997100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 80/165] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:47 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:49.014268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:49.015006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:49.021461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:49.022080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:49.023207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:49.023781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:49.250389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:49.267884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4e0b0985-bd0b-4474-834e-271758b50785 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.252925 May 31 14:39:49.282946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 86/166] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:49 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:50.285985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:50.286745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:50.294236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.294810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:50.295667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.296386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:50.444856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:50.452844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d0a9c9f7-7f53-4074-9487-707e00d3116a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.170772 May 31 14:39:50.453869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 81/167] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:50 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:50.696170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:50.696680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:50.703336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.704009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:50.704880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.705308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:50.737103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:39:50.833346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c4133bbf-dfa6-4c41-b457-7e88b9c22f37 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 204 len: 0 microversion: 2.1 time: 0.140554 May 31 14:39:50.835105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 87/168] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:39:50 2022] DELETE /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:39:50.844644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:50.845416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:50.855136 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.856013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:50.856805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:50.857299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:51.019522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:51.029788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-64befd21-05a6-489b-a4e9-063e82679ebd tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1554 microversion: 2.1 time: 0.189381 May 31 14:39:51.040468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 82/169] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:50 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:51.471890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:51.473121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:51.480489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:51.481174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:51.482225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:51.482904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:51.633515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:51.648017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-16757102-09d5-46a1-9361-56a699f5de7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.181069 May 31 14:39:51.649100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 88/170] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:51 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:52.050730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:52.051958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:52.067217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:52.068079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:52.069500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:52.070374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:52.248070 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:52.256845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ea807b1c-c3a2-44e2-ba53-709bbd3d26cb tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1554 microversion: 2.1 time: 0.213192 May 31 14:39:52.257734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 83/171] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:52 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:52.668518 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:52.670451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:52.678485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:52.678958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:52.679892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:52.680525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:52.904235 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:52.912284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e737822c-7e1d-49e4-a02e-82e9bde82418 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.248554 May 31 14:39:52.913075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 89/172] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:52 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:39:53.277657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:53.279417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:53.286123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:53.287173 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:53.288249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:53.288692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:53.472248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:53.485805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8578a3a4-380a-4ab2-8758-614a04035e7d tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1554 microversion: 2.1 time: 0.215801 May 31 14:39:53.487381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 84/173] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:53 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:53.931369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:53.932984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:53.939929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:53.940385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:53.941154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:53.941592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:54.105128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:54.113978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4fcc08c9-1a01-43b8-83b8-2262214968c3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.187119 May 31 14:39:54.114896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 90/174] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:53 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:54.332492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-eb9dffc5-214d-4fd1-8d5a-fb8000ff1670 req-d6ea0398-ca58-41ca-8de9-48f02a929b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b82b1e9-fc5f-4b2a-8664-7f322485f0b0", "name": "network-vif-deleted", "tag": "3f4f5385-3fde-43ed-9d4d-9d7f4928cc90"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:39:54.341129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-eb9dffc5-214d-4fd1-8d5a-fb8000ff1670 req-d6ea0398-ca58-41ca-8de9-48f02a929b99 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:54.341669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-eb9dffc5-214d-4fd1-8d5a-fb8000ff1670 req-d6ea0398-ca58-41ca-8de9-48f02a929b99 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:54.354425 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-eb9dffc5-214d-4fd1-8d5a-fb8000ff1670 req-d6ea0398-ca58-41ca-8de9-48f02a929b99 service nova] Creating event network-vif-deleted:3f4f5385-3fde-43ed-9d4d-9d7f4928cc90 for instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 on hv-cinder-83979 May 31 14:39:54.360812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-eb9dffc5-214d-4fd1-8d5a-fb8000ff1670 req-d6ea0398-ca58-41ca-8de9-48f02a929b99 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 May 31 14:39:54.361606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 85/175] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:39:54.505264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:54.506020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:54.516032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:54.516993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:54.518227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:54.518954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:54.603252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:54.611530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-94b9443b-cc90-4644-a766-37edaa7cf498 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.111207 May 31 14:39:54.612095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 91/176] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:54 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:55.133036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:55.134553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:55.141732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:55.142396 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:55.143418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:55.144030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:55.295827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:55.303244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-83ca3dec-6966-44ef-b630-5c9daa1c608d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.175558 May 31 14:39:55.303807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 86/177] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:55 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:55.628271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:55.628881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:55.635255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:55.635671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:55.636427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:55.636863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:55.701575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:55.710009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-54cd42dc-2c50-470d-8680-87d22b933818 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.085549 May 31 14:39:55.710591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 92/178] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:55 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:56.321093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:56.321706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:56.327750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:56.328203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:56.328959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:56.329405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:56.458834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:56.466200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-91f3181b-b0f6-463b-af1e-73652a0aed50 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.149482 May 31 14:39:56.466782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 87/179] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:56 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:56.726727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:56.727924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:56.734836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:56.735282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:56.736039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:56.736473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:56.797107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:56.804837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4c3beff9-eae0-4a62-be7f-3fb03712f1b2 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.082132 May 31 14:39:56.805406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 93/180] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:56 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:57.483485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:57.484091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:57.490078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:57.490527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:57.491329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:57.491753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:57.620622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:57.627965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fb73d4d1-6526-417a-831d-1d6ee5a25259 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.148330 May 31 14:39:57.628535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 88/181] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:57 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:57.821896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:57.822468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:57.828870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:57.829315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:57.830064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:57.830494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:57.891831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:57.900087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f8fb7a62-85b3-4fdb-b098-2c60a0a8dd60 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.082147 May 31 14:39:57.900657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 94/182] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:57 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:58.645041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:58.645644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:58.651665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:58.652732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:58.653491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:58.653925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:58.778672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:58.786077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3b3221cb-c2eb-48b1-a485-1de7a0e5272a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.144889 May 31 14:39:58.786637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 89/183] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:58 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:58.916819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:58.917429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:58.923760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:58.924200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:58.925074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:58.925504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:58.990403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:58.998855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-53961b59-4624-4a2d-8b4f-41969d0b9d3e tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.085870 May 31 14:39:58.999431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 95/184] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:58 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:39:59.802783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:39:59.803398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:39:59.809436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:59.809887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:59.810654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:39:59.811102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:39:59.940632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:39:59.948064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bf3e7338-0dfe-45ff-b740-c29e83a5a385 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.149119 May 31 14:39:59.948632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 90/185] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:39:59 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:00.015513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:00.016121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:00.022538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:00.023017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:00.023771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:00.024209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:00.085157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:00.093835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9ae7b557-8560-4816-8319-514e1e41e430 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1346 microversion: 2.1 time: 0.082152 May 31 14:40:00.094411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 96/186] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:00 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:00.966143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:00.966933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:00.975098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:00.975648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:00.976481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:00.977121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:01.112694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:01.113227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:01.123775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:01.123775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:01.123775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:01.123775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:01.124100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:01.133979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a0c52ddf-2347-42f0-a863-a5f2f1f6714c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.171408 May 31 14:40:01.135150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 91/187] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:00 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:01.159177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:01.159620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:01.160059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lazy-loading 'fault' on Instance uuid 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:40:01.203785 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea126c816da740dda9622f7bfa10dd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0300307fde534d49a050041217cfe6e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:01.212796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f1d4f01c-6ba9-4fab-b052-2ce795c0e34a tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 200 len: 1351 microversion: 2.1 time: 0.105710 May 31 14:40:01.213376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 97/188] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:01 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:02.155060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:02.155678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:02.162043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.162479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.163258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.163688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.231656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:02.235993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:02.245370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.246714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.247589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.249406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.266328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] HTTP exception thrown: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Request method failure captured: May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 HTTP/1.1 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihr8o1I-9S1C0zI0B2STkcMrKcbaod5eZ98X2DCasFxFrTC2FEuNQ_KKuhBKWZpuyig2RJIEHEuyryQ75iZlp88xHbxbJQ0_r_bclxY-5ocf50HQc2g5CCc7xHiH2W9OdJj343QJbM0UyM8Cwogp8NmoKPyTq0biquEdnG67YxSXdI May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:40:02.285729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0300307fde534d49a050041217cfe6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0300307fde534d49a050041217cfe6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: ea126c816da740dda9622f7bfa10dd16 May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.287273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '6b82b1e9-fc5f-4b2a-8664-7f322485f0b0'} May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:40:02.288303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.289651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.292912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Returning 404 to user: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:40:02.295091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e6face93-c539-4cb8-a64f-3da2f1d52cae tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 404 len: 111 microversion: 2.1 time: 0.068015 May 31 14:40:02.295994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 98/189] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:02 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:40:02.331551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:02.339568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-26def2d5-b857-4248-919c-acf3904327ec tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.191476 May 31 14:40:02.340133 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 92/190] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:02 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:02.420754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:02.421751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:02.427912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.428358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.429120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:02.429557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:02.443097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] HTTP exception thrown: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Request method failure captured: May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0/os-volume_attachments HTTP/1.1 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihr8o1I-9S1C0zI0B2STkcMrKcbaod5eZ98X2DCasFxFrTC2FEuNQ_KKuhBKWZpuyig2RJIEHEuyryQ75iZlp88xHbxbJQ0_r_bclxY-5ocf50HQc2g5CCc7xHiH2W9OdJj343QJbM0UyM8Cwogp8NmoKPyTq0biquEdnG67YxSXdI May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:40:02.444626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0300307fde534d49a050041217cfe6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0300307fde534d49a050041217cfe6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: ea126c816da740dda9622f7bfa10dd16 May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.445998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'server_id': '6b82b1e9-fc5f-4b2a-8664-7f322485f0b0'} May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:40:02.446906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:02.448167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:02.449486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Returning 404 to user: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:40:02.449486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-16f4c016-e17b-4ecb-97f6-60c9fc7707b4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031973 May 31 14:40:02.449486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 99/191] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:40:02 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:40:03.355743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:03.356358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:03.362340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:03.362827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:03.363585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:03.364023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:03.503456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:03.510898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cada615a-f4b1-4dea-adc8-82d82db06ed7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.158863 May 31 14:40:03.512122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 93/192] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:03 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:04.528585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:04.529114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:04.531649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:04.536882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:04.537322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:04.538070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:04.538499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:04.676258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:04.684022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-05d1bad1-e33a-42c4-9fa0-8b0c9ac0eecc tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.159595 May 31 14:40:04.684593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 100/193] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:04 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:05.701493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:05.702034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:05.704087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=60 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:05.709562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:05.710040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:05.710828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:05.711259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:05.838982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:05.846911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bf1762e7-0a76-4836-8d5e-1624d003ff2f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.149244 May 31 14:40:05.847483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 94/194] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:05 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:06.863801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:06.864409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:06.870761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:06.871898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:06.872645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:06.873070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:06.876957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:07.004997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:07.012423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f4280c0d-dc80-47a5-8e77-83e02490f1a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.152445 May 31 14:40:07.012934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 101/195] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:06 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:08.028147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:08.028754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:08.034742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:08.035196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:08.035955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:08.036392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:08.165410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:08.173176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5e662cb4-4a59-44ac-be1c-440e2993dc70 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.148828 May 31 14:40:08.174251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 95/196] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:08 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:09.190575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:09.191230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:09.197694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:09.198230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:09.199013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:09.199443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:09.339214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:09.347237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bb5ad507-8922-48f8-9107-fa35cffe44fe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.160731 May 31 14:40:09.347798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 102/197] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:09 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:10.364954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:10.369855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:10.378247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:10.379064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:10.379967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:10.380560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:10.524128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:10.531870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bf7157c5-a77f-443c-8316-0a2a07cbbf99 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.171676 May 31 14:40:10.534919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 96/198] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:10 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:10.998456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:10.999000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:11.006132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.006582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.017615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.017615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.027439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] HTTP exception thrown: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Request method failure captured: May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 HTTP/1.1 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihr8o1I-9S1C0zI0B2STkcMrKcbaod5eZ98X2DCasFxFrTC2FEuNQ_KKuhBKWZpuyig2RJIEHEuyryQ75iZlp88xHbxbJQ0_r_bclxY-5ocf50HQc2g5CCc7xHiH2W9OdJj343QJbM0UyM8Cwogp8NmoKPyTq0biquEdnG67YxSXdI May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:40:11.029033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0300307fde534d49a050041217cfe6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0300307fde534d49a050041217cfe6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: ea126c816da740dda9622f7bfa10dd16 May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.030226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '6b82b1e9-fc5f-4b2a-8664-7f322485f0b0'} May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:40:11.030953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.036481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:40:11.037878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Returning 404 to user: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:40:11.037878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8593b4b2-61ec-49cf-9581-519d23ad4e17 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 404 len: 111 microversion: 2.1 time: 0.036526 May 31 14:40:11.037878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 103/199] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:40:10 2022] DELETE /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:40:11.042041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:11.042768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] [instance: 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:11.050525 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.051137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.051975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.052476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.069205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] HTTP exception thrown: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Request method failure captured: May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 HTTP/1.1 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilihr8o1I-9S1C0zI0B2STkcMrKcbaod5eZ98X2DCasFxFrTC2FEuNQ_KKuhBKWZpuyig2RJIEHEuyryQ75iZlp88xHbxbJQ0_r_bclxY-5ocf50HQc2g5CCc7xHiH2W9OdJj343QJbM0UyM8Cwogp8NmoKPyTq0biquEdnG67YxSXdI May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:40:11.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0300307fde534d49a050041217cfe6e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0300307fde534d49a050041217cfe6e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0300307fde534d49a050041217cfe6e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 0300307fde534d49a050041217cfe6e1 May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-DeleteServersTestJSON-847233104 May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: ea126c816da740dda9622f7bfa10dd16 May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-DeleteServersTestJSON-847233104-project May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.076250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '6b82b1e9-fc5f-4b2a-8664-7f322485f0b0'} May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:40:11.077238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. May 31 14:40:11.078515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:11.079814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] Returning 404 to user: Instance 6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:40:11.080522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d661f11-9b1f-407f-9972-7670225355f4 tempest-DeleteServersTestJSON-847233104 tempest-DeleteServersTestJSON-847233104-project] 10.222.0.67 "GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0" status: 404 len: 111 microversion: 2.1 time: 0.045618 May 31 14:40:11.081481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 97/200] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:11 2022] GET /compute/v2.1/servers/6b82b1e9-fc5f-4b2a-8664-7f322485f0b0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:40:11.549332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:11.550017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:11.558083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.558898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.560597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:11.561394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:11.798914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:11.815701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4d0b18d6-b5b0-4620-9530-5bddfd566467 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.267843 May 31 14:40:11.816764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 104/201] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:11 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:12.833588 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:12.834419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:12.842088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:12.842666 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:12.843514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:12.844124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:12.990144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:12.994024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:13.000642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3870e649-ac03-42a3-81a9-d1e3bf7ddc2b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.171046 May 31 14:40:13.001428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 98/202] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:12 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:14.020808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:14.022771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:14.029781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:14.030560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:14.031361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:14.031970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:14.177556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:14.182713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d77ffe7c-904e-46e9-ae8d-9cada1af8e7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.167678 May 31 14:40:14.186692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 105/203] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:14 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:15.200465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:15.202328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:15.209019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:15.209477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:15.210252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:15.210708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:15.389293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:15.398414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-91ac0122-0460-4202-8714-c38b58608a25 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.202232 May 31 14:40:15.399028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 99/204] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:15 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:16.420129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:16.420742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:16.429046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:16.430325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:16.431326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:16.431920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:16.864908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:16.873913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f876fa16-a07e-46a2-b6de-54f050157763 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.461891 May 31 14:40:16.874703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 106/205] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:16 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:17.892328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:17.892944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:17.901497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:17.902099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:17.902954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:17.903392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:18.075988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:18.084312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5575839c-ce39-4574-9cff-458196336fee tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.196968 May 31 14:40:18.084860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 100/206] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:17 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:18.204411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e0b0c764-685d-4fc6-abba-ef6d7d56b2b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: .version_select at 0x7f8dc404c8b0>, body: {"keypair": {"name": "tempest-keypair-413640206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmsLz6sF9orc0HV3PhY8fBiQcIWm/S8xB3Gg/0sY/DHrzzWYJ9m+gdUeLcgk/xOPMABbQ7+gWwOx0+TAbOcdjRwgBnvmXYlMA4F/ohSb+6fMOWMwwcB76xH8B/wJ/ZHiA=="}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:18.223990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-e0b0c764-685d-4fc6-abba-ef6d7d56b2b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for project 502541429884445e8426837b3fd0d75e. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:40:18.227966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-e0b0c764-685d-4fc6-abba-ef6d7d56b2b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for user 32e6ace174a840f78c8d570719c3f631 and project 502541429884445e8426837b3fd0d75e. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:40:18.266583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e0b0c764-685d-4fc6-abba-ef6d7d56b2b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.183079 May 31 14:40:18.267224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 107/207] 10.222.0.67 () {62 vars in 1199 bytes} [Tue May 31 14:40:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 14:40:19.101367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:19.103140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:19.109650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:19.110345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:19.111728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:19.112172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:19.284870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:19.298494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d59baeb7-e87a-4e77-9f56-2d029c8ac4ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.200170 May 31 14:40:19.299298 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 101/208] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:19 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:19.898059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1566997196", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6fd330-7eff-44a3-9a38-d7eefcd25440"}], "security_groups": [{"name": "tempest-securitygroup--1130246472"}], "key_name": "tempest-keypair-413640206", "user_data": "}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:20.021757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] validate_networks() for [('9a6fd330-7eff-44a3-9a38-d7eefcd25440', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:40:20.175034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2097072963", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:20.269408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] validate_networks() for None {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:40:20.786190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:40:20.787112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:40:20.787649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:40:20.788115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:40:20.788532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:40:20.805561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.806252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:20.807266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.807923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:20.827591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Getting quotas for project 7dadc6972be242a48c64084726085851. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:40:20.831721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Getting quotas for user ab5d06b0a3324dab903f485342590db9 and project 7dadc6972be242a48c64084726085851. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:40:20.845964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:40:20.848657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:40:20.857005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:40:20.857472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:40:20.858203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:40:20.858604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:40:20.859209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:40:20.868810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.869624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:20.870582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.871315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:20.904736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for project 502541429884445e8426837b3fd0d75e. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:40:20.912073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for user 32e6ace174a840f78c8d570719c3f631 and project 502541429884445e8426837b3fd0d75e. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:40:20.919483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ff0d9ca8-7299-4c9d-b2c0-3e40d155f66c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747318 May 31 14:40:20.922384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 102/209] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 14:40:20.938795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:40:20.940051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:20.941439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:20.967873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:40:20.968855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.969320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:20.970470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:20.987165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:21.059676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f060a70d-0aa5-4275-aecd-a4592aeaca58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.166918 May 31 14:40:21.078323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 108/210] 10.222.0.67 () {62 vars in 1187 bytes} [Tue May 31 14:40:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 14:40:21.098240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-95890cd5-27ac-4bb8-8557-0fc335d633df tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:21.099439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-95890cd5-27ac-4bb8-8557-0fc335d633df tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:21.253392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-95890cd5-27ac-4bb8-8557-0fc335d633df tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:21.261926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-95890cd5-27ac-4bb8-8557-0fc335d633df tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1215 microversion: 2.1 time: 0.172170 May 31 14:40:21.262933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 109/211] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:21 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:21.278765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:21.280559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:21.282081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:21.291044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37d77687-0980-42c8-b85e-d743f55ac134 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.367326 May 31 14:40:21.291638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 103/212] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:20 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:21.351815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:21.361006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:21.362431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:21.363701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-05855836-4f03-4342-80e9-b78da00389da tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1281 microversion: 2.20 time: 0.090490 May 31 14:40:21.364895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 110/213] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:21 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:22.279280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:22.279896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:22.286151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.286787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.287405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.287833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.308694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:22.310754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:22.317416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.317899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.318707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.319155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.350703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:22.358808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f049a82f-2fd9-4ce8-87f7-14d1bfbff193 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1275 microversion: 2.1 time: 0.083794 May 31 14:40:22.359396 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 104/214] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:22 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:22.382854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:22.383503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:22.390189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.390669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.391442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:22.391885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:22.634407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:22.642996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:22.644536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:22.646202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d00a4ea1-240d-41d3-a82b-ea820c17a158 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1333 microversion: 2.20 time: 0.266706 May 31 14:40:22.646202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 105/215] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:22 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1333 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:22.662526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:22.670497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cbda7fcd-4dec-4c48-aa2b-700705d9e975 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.365594 May 31 14:40:22.671105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 111/216] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:22 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:23.376344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:23.376956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:23.383042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.383498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.384260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.384700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.444725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:23.452490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f130701a-89d8-442a-8016-198b1b5de552 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1275 microversion: 2.1 time: 0.080009 May 31 14:40:23.453055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 106/217] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:23 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1275 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:23.663879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:23.664604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:23.671750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.672192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.672932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.673361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.687419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:23.688108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:23.694163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.694612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.695758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:23.696200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:23.737377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:23.745330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:23.746843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:23.747978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b1c87fb9-a77f-4394-8084-622feee8b410 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1333 microversion: 2.20 time: 0.087990 May 31 14:40:23.748527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 112/218] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:23 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:23.834791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:23.842771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eb7c1887-60bd-400c-b071-a0149e9abfb1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.159149 May 31 14:40:23.843331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 107/219] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:23 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:24.469067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:24.469675 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:24.475649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.476097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:24.476847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.477279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:24.537938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:24.545379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-db10d7d3-6901-4034-b331-40b71246246a tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1275 microversion: 2.1 time: 0.080129 May 31 14:40:24.545939 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 113/220] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:24 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1275 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:24.766517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:24.767171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:24.773175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.773626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:24.774382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.774850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:24.836305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:24.844748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:24.846340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:24.847584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-69114ce1-e5af-4490-8e10-d4d5119e9f1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1333 microversion: 2.20 time: 0.085651 May 31 14:40:24.848227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 108/221] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:24 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:24.860355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:24.861109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:24.867652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.868094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:24.868873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:24.869303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:25.005347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:25.012715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e3173fd7-df82-45a2-a625-14c0274daf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.156978 May 31 14:40:25.013332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 114/222] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:24 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:25.561772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:25.562379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:25.569522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:25.569962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:25.570735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:25.571164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:25.632878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:25.640623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fa48c854-57cf-47f8-8307-33bdaf8547c9 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1275 microversion: 2.1 time: 0.082755 May 31 14:40:25.641175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 109/223] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:25 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:25.865323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:25.865848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:25.872399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:25.872846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:25.873606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:25.874005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:25.935371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:25.943358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:25.944848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:25.945926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e10cec66-aaf3-4764-bb67-b7fc99a3c379 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1333 microversion: 2.20 time: 0.084563 May 31 14:40:25.946476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 115/224] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:25 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:26.029881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:26.030484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:26.036445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.036889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:26.037635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.038067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:26.171351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:26.178739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fe268200-5f8c-4b89-9e56-c8650ab952a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.152827 May 31 14:40:26.179292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 110/225] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:26 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:26.659290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:26.659906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:26.665856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.666309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:26.667120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.667557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:26.728862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:26.736846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dac08708-04ba-487f-b514-fc32804fccd7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1275 microversion: 2.1 time: 0.081545 May 31 14:40:26.737403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 116/226] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:26 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:26.964216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:26.964824 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:26.971266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.971717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:26.972474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:26.972910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:27.034314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:27.042162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:27.043719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:27.044831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2a01a3df-3e83-4901-a1e7-7978dbf656b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1333 microversion: 2.20 time: 0.084543 May 31 14:40:27.045377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 111/227] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:26 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:27.195965 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:27.196583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:27.203554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:27.204009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:27.204795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:27.205236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:27.335334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:27.343483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-317ce0ba-f750-4707-8a6e-07fd15bff176 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.151388 May 31 14:40:27.344057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 117/228] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:27 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:27.754216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:27.754932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:27.761722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:27.762178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:27.763020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:27.764198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:27.834210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:27.842713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c39daa4a-9627-4416-89e1-f077e9de2bf7 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1285 microversion: 2.1 time: 0.092378 May 31 14:40:27.843558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 112/229] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:27 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:28.062592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:28.063498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:28.069441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.069895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:28.070690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.071137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:28.133612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:28.141516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:28.143078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:28.144174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-55093dfd-a08e-4393-9ea0-b9c5e634d599 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1339 microversion: 2.20 time: 0.086303 May 31 14:40:28.144735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 118/230] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:28 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:28.360937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:28.361555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:28.367821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.368336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:28.369189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.369635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:28.503878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:28.511663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-00e1eec2-a7c9-4d5a-b1f9-374936593246 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.155116 May 31 14:40:28.512229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 113/231] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:28 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:28.864720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:28.865298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:28.877451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.877902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:28.879406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:28.880546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:29.108576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:29.124512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ab831fad-7a60-4102-9c72-c2040bcdd3ff tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.266631 May 31 14:40:29.125112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 119/232] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:28 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:29.163355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:29.163971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:29.176176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:29.176745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:29.177618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:29.178127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:29.255540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:29.264748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:29.266280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:29.267429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c747be98-190e-479c-8d0c-5762b3df2726 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1339 microversion: 2.20 time: 0.108234 May 31 14:40:29.270714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 114/233] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:29 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:29.529810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:29.530428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:29.545132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:29.545845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:29.546759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:29.547403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:29.698968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:29.707517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b0247341-63be-4ae1-ab59-05d6f6861667 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1522 microversion: 2.1 time: 0.182189 May 31 14:40:29.708103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 120/234] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:29 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:30.147932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:30.149157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:30.158136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-c1de8c34-c394-4967-9268-7d892088c2e2 req-204984fe-f214-4151-92b7-28c16a56f113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91497a0b-092d-4fba-81be-ad4b7842a79b", "tag": "0b9bf6c4-2990-43b7-9c87-86d27236268b"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:30.174430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.174871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.175672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.176069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-c1de8c34-c394-4967-9268-7d892088c2e2 req-204984fe-f214-4151-92b7-28c16a56f113 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.176184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.176515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-c1de8c34-c394-4967-9268-7d892088c2e2 req-204984fe-f214-4151-92b7-28c16a56f113 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.188701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-c1de8c34-c394-4967-9268-7d892088c2e2 req-204984fe-f214-4151-92b7-28c16a56f113 service nova] Creating event network-changed:0b9bf6c4-2990-43b7-9c87-86d27236268b for instance 91497a0b-092d-4fba-81be-ad4b7842a79b on hv-cinder-83979 May 31 14:40:30.193854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-c1de8c34-c394-4967-9268-7d892088c2e2 req-204984fe-f214-4151-92b7-28c16a56f113 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044966 May 31 14:40:30.195031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 121/235] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:40:30.286673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:30.287702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:30.303213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.303213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.303213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.303213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.363355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:30.370730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2356fa86-07de-4897-a1ce-8d2b2a2ce683 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.233194 May 31 14:40:30.371668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 115/236] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:30 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:30.479070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:30.481354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:30.488556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:30.490052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:30.491195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-03dacb97-0d8a-4658-acf5-ddc393bce95d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.208820 May 31 14:40:30.491787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 122/237] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:30 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:30.725024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:30.725646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:30.731923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.732382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.733174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.733615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.737544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:30.817095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:30.839240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:30.869088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:30.877046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-89ef0f52-8236-48b2-8c07-e691ada3eeb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1502 microversion: 2.1 time: 0.155768 May 31 14:40:30.877551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 116/238] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:30 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:30.893556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:30.894163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:30.896008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:30.901915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.902476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:30.903348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:30.904431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:31.058986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:31.067659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-87381c31-c4ea-4591-8c25-35c0c7fd3319 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1515 microversion: 2.1 time: 0.177845 May 31 14:40:31.068328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 123/239] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:30 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:31.389917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:31.390541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:31.402303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:31.402780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:31.403554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:31.404023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:31.509949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:31.511146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:31.513920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=14 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:31.523649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:31.524095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:31.526183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:31.530961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:31.599715 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:31.607293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7730eab0-a07b-4d14-9bc4-24abda58ff28 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.222780 May 31 14:40:31.607927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 117/240] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:31 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:31.683495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:31.692619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:31.694032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:31.695168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dbe702e3-9790-4587-94a0-376e5caf6e84 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.189476 May 31 14:40:31.695730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 124/241] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:31 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:32.209764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-25ea73fa-b2e7-4781-9968-cfefc64ceafc req-60d0c61d-8eb8-4115-bcbb-a2e6ab436ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:32.217731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-25ea73fa-b2e7-4781-9968-cfefc64ceafc req-60d0c61d-8eb8-4115-bcbb-a2e6ab436ae8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:32.218171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-25ea73fa-b2e7-4781-9968-cfefc64ceafc req-60d0c61d-8eb8-4115-bcbb-a2e6ab436ae8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:32.228615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-25ea73fa-b2e7-4781-9968-cfefc64ceafc req-60d0c61d-8eb8-4115-bcbb-a2e6ab436ae8 service nova] Creating event network-changed:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:40:32.233365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-25ea73fa-b2e7-4781-9968-cfefc64ceafc req-60d0c61d-8eb8-4115-bcbb-a2e6ab436ae8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027313 May 31 14:40:32.233919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 118/242] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:40:32.624477 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:32.625081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:32.634839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:32.634839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:32.634839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:32.634839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:32.713587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:32.714268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:32.720903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:32.721341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:32.722093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:32.722514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:32.769485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:32.776942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1c908e1b-9669-4d1e-871e-106186029e8b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.156770 May 31 14:40:32.777509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 125/243] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:32 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:32.855103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:32.863423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:32.864926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:32.866029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-18189a1d-4fb4-49bf-aeeb-b8fb12b16f74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.156699 May 31 14:40:32.866591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 119/244] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:32 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:33.794176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:33.795515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:33.802054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:33.802498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:33.803709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:33.804147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:33.884129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:33.884835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:33.891004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:33.891532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:33.892420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:33.892853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:33.939625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:33.946888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-78d9e9e3-f404-4bf3-bd8d-6d23d2f3c92f tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.156533 May 31 14:40:33.947461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 126/245] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:33 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:34.030921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:34.042066 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:34.044640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:34.047138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d43e6178-d352-4507-a8f1-bb0aebaca928 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.166720 May 31 14:40:34.048025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 120/246] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:33 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:34.965538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:34.966420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:34.969234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:34.976593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:34.977046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:34.977819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:34.978261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:35.065886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:35.066515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:35.072603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:35.073053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:35.073826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:35.074273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:35.109417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:35.119086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ffc42e15-1e67-4064-a6ad-cd77655ad61c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.157487 May 31 14:40:35.119086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 127/247] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:34 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:35.203027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:35.211246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:35.212732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:35.213817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-91fd2865-f8d3-49fe-adfd-c99dbee00cec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.152468 May 31 14:40:35.214365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 121/248] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:35 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:36.134980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:36.135604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:36.142847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:36.143304 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:36.144088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:36.144531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:36.231805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:36.232676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:36.234738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:36.240874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:36.241326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:36.242322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:36.242942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:36.296714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:36.305096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-011c63de-62b6-40ce-90cd-70f0fdcf8004 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.173928 May 31 14:40:36.305679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 128/249] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:36 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:36.382703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:36.392455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:36.394367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:36.395696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6a231c9e-141c-4e5a-a413-6ef80871d33e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.167682 May 31 14:40:36.396333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 122/250] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:36 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:37.321944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:37.322543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:37.329132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:37.329576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:37.330321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:37.330784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:37.413329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:37.413930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:37.420305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:37.420756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:37.422176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:37.422614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:37.470894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:37.478554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bfb6b08d-bdbe-4cc8-b27e-69d9677066eb tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.160498 May 31 14:40:37.479157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 129/251] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:37 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:37.553346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:37.561247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:37.562794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:37.564134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d3c24ed8-ca2a-453b-8d74-a95cbb6ff563 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.154665 May 31 14:40:37.564671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 123/252] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:37 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:38.495206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:38.495838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:38.502339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:38.502831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:38.503594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:38.504033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:38.582521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:38.583169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:38.589183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:38.589639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:38.590610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:38.591076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:38.648943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:38.656856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e3e454cd-798d-4bc1-a5ad-a40ecff9b308 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.165554 May 31 14:40:38.657439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 130/253] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:38 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:38.730143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:38.738194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:38.739789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:38.740892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-85830602-acc3-4db7-8ae9-bf9c6faf46ab tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.162518 May 31 14:40:38.741452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 124/254] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:38 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:39.674118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:39.674758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:39.683530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:39.683530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:39.683530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:39.683530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:39.760120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:39.760761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:39.767167 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:39.767617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:39.768382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:39.768857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:39.820532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:39.828530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dbddedc4-4c32-4384-a913-0745e17d5ba4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.158930 May 31 14:40:39.829306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 131/255] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:39 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:39.921355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:39.930129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:39.931708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:39.932825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dbd4e905-ff29-4549-8441-079e97f3bb3e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.177580 May 31 14:40:39.933549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 125/256] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:39 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:40.846020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:40.847828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:40.863064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:40.863515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:40.864314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:40.865947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:40.951009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:40.952122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:40.969900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:40.973112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:40.974051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:40.976188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:41.059770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:41.067969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-06bc8272-2401-4b5f-8cee-c65d4f8a210c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.226537 May 31 14:40:41.068551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 132/257] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:40 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:41.130182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:41.138220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:41.139839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:41.141449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1506b959-3495-4836-a8bc-80f19d98b6b7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.194555 May 31 14:40:41.142006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 126/258] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:40 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:42.085025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:42.085641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:42.092109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:42.092560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:42.093323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:42.093772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:42.160197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:42.160813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:42.166780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:42.167235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:42.167993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:42.168426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:42.248923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:42.256276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0b3d4202-c910-4146-a7bb-f5decf12cb76 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.175059 May 31 14:40:42.256934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 133/259] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:42 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:42.307738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:42.316861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:42.318382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:42.319522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c781a475-f567-4504-a66b-96888fe57dbf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.163910 May 31 14:40:42.320079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 127/260] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:42 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:42.995879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:42.996894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:43.002967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.003413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.004169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.004601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.028688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lazy-loading 'flavor' on Instance uuid d93b6401-2207-4636-98d0-f2e324cc2879 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:40:43.105351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3378c37e-5f34-4865-ab71-bace37bb2250 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/action" status: 200 len: 32 microversion: 2.1 time: 0.113337 May 31 14:40:43.106403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 134/261] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:40:42 2022] POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 14:40:43.114961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:43.115576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:43.122801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.123500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.124464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.125073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.259662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:43.267870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a66ed02b-a1e9-47a8-97be-ccf9885e3a97 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.156604 May 31 14:40:43.268733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 128/262] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:43 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:43.273575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:43.274279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:43.280519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.281024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.282320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.282803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.338127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:43.338667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:43.345023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.345747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.346574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:43.347012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:43.469109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:43.476898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bfb166fe-ddc0-49bb-aafd-9c324dee44ad tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.207748 May 31 14:40:43.477553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 135/263] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:43 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:43.513985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:43.522556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:43.524102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:43.525272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4f3a4f6c-af1d-4e33-af02-578661f3ef1c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.191884 May 31 14:40:43.525833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 129/264] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:43 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:44.285134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:44.285908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:44.293174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.293693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.294524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.295076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.428147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:44.435737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-686a136e-54ee-4023-ad99-7198715e85ff tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.154431 May 31 14:40:44.436334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 136/265] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:44 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:44.493286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:44.493902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:44.500000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.500972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.501730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.502164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.543669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:44.544565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:44.550742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.551191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.551952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:44.552384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:44.567583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:44.680838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:44.688827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-87cf62fa-c2a5-4cce-b99d-7f7a2e203316 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.199384 May 31 14:40:44.689394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 130/266] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:44 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:44.707800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:44.715504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:44.716990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:44.718075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-46e3a48a-493f-4ea5-8474-a8664ab2473b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.178374 May 31 14:40:44.718853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 137/267] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:44 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:45.455585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:45.456317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:45.463088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.463553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.464374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.464815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.605407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:45.615370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5197fa84-7b99-4b45-87ac-2a0ad5baeb3e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.164768 May 31 14:40:45.616309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 131/268] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:45 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:45.705999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:45.706601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:45.712952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.713398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.714183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.714617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.737638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:45.738238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:45.744160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.744606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.745357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:45.745784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:45.900731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:45.908975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-627e87db-d102-4e41-b7ae-9460f6829c07 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.207535 May 31 14:40:45.909562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 138/269] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:45 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:45.932111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:45.941255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:45.942813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:45.944150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4b7ee384-3bab-4829-be47-1f8b06cfb080 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.210852 May 31 14:40:45.944721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 132/270] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:45 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:46.632982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:46.633583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:46.639488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.639937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:46.642231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.642698 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:46.772757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:46.782107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-46b7d79b-0a38-43da-a8fc-22fcbc877485 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.152787 May 31 14:40:46.782733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 139/271] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:46 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:46.926998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:46.927954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:46.934164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.934621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:46.935477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.935980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:46.954492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:46.962392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:46.963265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:46.970443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.971026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:46.972156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:46.972692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:47.132058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:47.139880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5ae4b2bb-2295-40c4-bb7a-ec862730f5e5 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.218139 May 31 14:40:47.140559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 133/272] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:46 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:47.162151 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:47.170063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:47.171593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:47.173287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-87cb1b21-366b-4785-b369-39da253317c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.215177 May 31 14:40:47.173845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 140/273] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:46 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:47.800999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:47.802060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:47.811975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:47.813692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:47.815134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:47.815839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.007317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:48.017256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8275551d-32d1-4d88-ac91-df77cbbc3e95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.221234 May 31 14:40:48.017836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 134/274] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:47 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:48.093228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-a804a893-002d-49fb-a8b0-3a3576270263 req-5b66c6fc-9199-4c53-bd57-576531e14edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91497a0b-092d-4fba-81be-ad4b7842a79b", "name": "network-vif-plugged", "status": "completed", "tag": "0b9bf6c4-2990-43b7-9c87-86d27236268b"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:48.129851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-a804a893-002d-49fb-a8b0-3a3576270263 req-5b66c6fc-9199-4c53-bd57-576531e14edf service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:48.134865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-a804a893-002d-49fb-a8b0-3a3576270263 req-5b66c6fc-9199-4c53-bd57-576531e14edf service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.157180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:48.158089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:48.165327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:48.165783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.166617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-a804a893-002d-49fb-a8b0-3a3576270263 req-5b66c6fc-9199-4c53-bd57-576531e14edf service nova] Creating event network-vif-plugged:0b9bf6c4-2990-43b7-9c87-86d27236268b for instance 91497a0b-092d-4fba-81be-ad4b7842a79b on hv-cinder-83979 May 31 14:40:48.174389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:48.174952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.175808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-a804a893-002d-49fb-a8b0-3a3576270263 req-5b66c6fc-9199-4c53-bd57-576531e14edf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111099 May 31 14:40:48.176588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 141/275] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:40:48.192414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:48.193116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:48.206940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:48.207400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.208181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:48.211266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:48.442522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:48.442951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:48.459496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3594b1c0-72b4-406e-8450-97de3c98a7b4 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.306294 May 31 14:40:48.460998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 135/276] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:48 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:48.462448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:48.464127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:48.465593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fca0d74d-dc4d-43a7-a5f8-8591d4f625a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.278178 May 31 14:40:48.466168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 142/277] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:48 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:49.037019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:49.037726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:49.046225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.047187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.048268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.048816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.330212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:49.352626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-67c3e68c-f19d-4dc1-88da-3c5dfd390ab2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.318941 May 31 14:40:49.354409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 136/278] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:49 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:49.477996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:49.479954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:49.483599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:49.484879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:49.489573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.490837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.491618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.492212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.497091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.498250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.499461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:49.500896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:49.722842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:49.730099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:49.742857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:49.744360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:49.745468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38102ae9-d9aa-4559-98e5-32f5057c9cc8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.265791 May 31 14:40:49.746026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 137/279] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:49 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:49.747422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-54b47455-7683-49b9-86a0-91f943881cf8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1315 microversion: 2.1 time: 0.274201 May 31 14:40:49.748027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 143/280] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:49 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:50.371577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:50.372352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:50.380224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.381460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.382813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.383644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.548030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:50.572005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9308b832-5cc1-4770-89bb-8c6fcf253068 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.203636 May 31 14:40:50.584517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 144/281] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:50 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:50.764665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:50.769301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:50.770470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:50.771336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:50.778703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.779332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.780102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.780537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.784019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.784676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.785618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:50.786251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:50.995929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.000132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.004241 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.005748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.006893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3716977e-568a-4ba3-89b8-6d7ab9af771c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.246940 May 31 14:40:51.007704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c64a6071-198c-49de-b74f-7984c02c7ba8 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1465 microversion: 2.1 time: 0.246794 May 31 14:40:51.008089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 138/282] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:50 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:51.020921 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 145/283] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:50 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:51.051199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:51.051899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:51.057866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.058519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.059456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.060042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.089627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:40:51.228494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a78d535d-86ce-43ed-96b6-b25b0a35e53c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 204 len: 0 microversion: 2.1 time: 0.181219 May 31 14:40:51.230384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 139/284] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:40:51 2022] DELETE /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:40:51.243318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:51.250456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:51.275296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.276237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.277739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.278576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.439810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.448746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-30ff175d-aa8d-4090-9fa6-d5963b6442aa tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1471 microversion: 2.1 time: 0.213711 May 31 14:40:51.450949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 146/285] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:51 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:51.591470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:51.592292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:51.600408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.601072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.602029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:51.602617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:51.767134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:51.776554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a7358587-4b0b-4f3d-9d95-5a69157d0f32 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.189262 May 31 14:40:51.778058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 140/286] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:51 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:40:52.026021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:52.027514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:52.039374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.043138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.044208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.045073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.210849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-d113efcb-a48c-4a5b-9cee-6772711c3ba9 req-1a504026-b360-4258-8eaf-b8d490e6639d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "name": "network-vif-plugged", "status": "completed", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:52.224529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-d113efcb-a48c-4a5b-9cee-6772711c3ba9 req-1a504026-b360-4258-8eaf-b8d490e6639d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.225303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-d113efcb-a48c-4a5b-9cee-6772711c3ba9 req-1a504026-b360-4258-8eaf-b8d490e6639d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.238310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:52.241206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-d113efcb-a48c-4a5b-9cee-6772711c3ba9 req-1a504026-b360-4258-8eaf-b8d490e6639d service nova] Creating event network-vif-plugged:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:40:52.247333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-d113efcb-a48c-4a5b-9cee-6772711c3ba9 req-1a504026-b360-4258-8eaf-b8d490e6639d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043905 May 31 14:40:52.248077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 141/287] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:40:52.248990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:52.255676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:52.257347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dfacc203-05ae-44c5-b516-b50b46ecc205 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.235617 May 31 14:40:52.258543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 147/288] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:52 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:52.468206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:52.468895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:52.475864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.476507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.477445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.477908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.642669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:52.648794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-30749520-a85c-4311-ad3c-8063b1ae6b3c tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1471 microversion: 2.1 time: 0.184657 May 31 14:40:52.659828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 142/289] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:52 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:52.795369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:52.795928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:52.803016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.803467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:52.804408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:52.805050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.205082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:53.214912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f3e0815b-409b-4a83-b2d2-bbe5c28ddb20 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.423635 May 31 14:40:53.215515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 148/290] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:52 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:53.276607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:53.277357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:53.290490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:53.291671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.292780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:53.293925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.610012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:53.634893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:53.643819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:53.650713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab65bfed-7342-45c0-ac95-984b327a54ed tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.373524 May 31 14:40:53.651735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 143/291] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:53 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:53.668970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:53.669719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:53.676958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:53.677589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.678952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:53.679464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.904052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-95a3dc1b-83a0-49d8-9338-c31626483e30 req-9e768f46-6fd6-458e-9e75-2eb0b652f36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91497a0b-092d-4fba-81be-ad4b7842a79b", "name": "network-vif-deleted", "tag": "0b9bf6c4-2990-43b7-9c87-86d27236268b"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:53.905008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:53.913268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a9822238-38d5-431b-9877-20ecb9b83c0b tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1471 microversion: 2.1 time: 0.248666 May 31 14:40:53.914200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 149/292] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:53 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:53.923559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-95a3dc1b-83a0-49d8-9338-c31626483e30 req-9e768f46-6fd6-458e-9e75-2eb0b652f36c service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:53.923559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-95a3dc1b-83a0-49d8-9338-c31626483e30 req-9e768f46-6fd6-458e-9e75-2eb0b652f36c service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:53.929860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-95a3dc1b-83a0-49d8-9338-c31626483e30 req-9e768f46-6fd6-458e-9e75-2eb0b652f36c service nova] Creating event network-vif-deleted:0b9bf6c4-2990-43b7-9c87-86d27236268b for instance 91497a0b-092d-4fba-81be-ad4b7842a79b on hv-cinder-83979 May 31 14:40:53.935124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-95a3dc1b-83a0-49d8-9338-c31626483e30 req-9e768f46-6fd6-458e-9e75-2eb0b652f36c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035020 May 31 14:40:53.936047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 144/293] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:40:54.233604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:54.234146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:54.241271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.242089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.243196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.243709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.486258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:54.495671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2581ad7c-480c-4942-90f4-dd981522748c tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.265928 May 31 14:40:54.496251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 150/294] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:54 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:54.669836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:54.670530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:54.685347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.685818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.686599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.687061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.931152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:54.932093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:54.940303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.943173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.945115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:54.945893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:54.977592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:54.991427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:54.997860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:55.001358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-07628415-502e-4157-bcb2-6a5d902c305b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1407 microversion: 2.20 time: 0.334054 May 31 14:40:55.002001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 145/295] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:54 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:40:55.029940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:55.030781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:55.031601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lazy-loading 'fault' on Instance uuid 91497a0b-092d-4fba-81be-ad4b7842a79b {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:40:55.095521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d06b0a3324dab903f485342590db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dadc6972be242a48c64084726085851', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:55.110766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bad6def3-b52c-4e48-92e4-829872f94250 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 200 len: 1305 microversion: 2.1 time: 0.183425 May 31 14:40:55.111351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 151/296] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:54 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:55.514067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:55.514715 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:55.522347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:55.523468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:55.524541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:55.525338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:55.969507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:55.977193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3422abd7-69ed-4831-a488-454f35773d83 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.467490 May 31 14:40:55.977758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 146/297] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:55 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:56.021743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:56.029044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:56.045079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.045538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.047404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.047916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.132521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:56.133132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] [instance: 91497a0b-092d-4fba-81be-ad4b7842a79b] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:56.143367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.143910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.145280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.145818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.197746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] HTTP exception thrown: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Request method failure captured: May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b HTTP/1.1 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilijLntOWswMIu0L9hax1nj5pKy4jI6G8P6B8o9dYY9kgT847orVzdHWi2HSDZut1jh1nrEH3kxAkTdN9rKWIxLTUGW1EsF9NgqQUud7eS736wh5VXvCLi4n4XmMIrEV3e7H0v0hF-dsSisAKPiJYQc-ho3-S6hBnpHnZyrYTS8aE0EM May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 7dadc6972be242a48c64084726085851 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesNegativeTest-1038958799 May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:40:56.199626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7dadc6972be242a48c64084726085851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7dadc6972be242a48c64084726085851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7dadc6972be242a48c64084726085851"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7dadc6972be242a48c64084726085851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesNegativeTest-1038958799 May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 7dadc6972be242a48c64084726085851 May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesNegativeTest-1038958799 May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesNegativeTest-1038958799-project May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: ab5d06b0a3324dab903f485342590db9 May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesNegativeTest-1038958799-project May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. May 31 14:40:56.200911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '91497a0b-092d-4fba-81be-ad4b7842a79b'} May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:40:56.201953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. May 31 14:40:56.204483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:40:56.205544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] Returning 404 to user: Instance 91497a0b-092d-4fba-81be-ad4b7842a79b could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:40:56.208277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7354214e-d857-454e-850b-1f10f9db0226 tempest-VolumesNegativeTest-1038958799 tempest-VolumesNegativeTest-1038958799-project] 10.222.0.67 "GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b" status: 404 len: 111 microversion: 2.1 time: 0.082173 May 31 14:40:56.209224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 147/298] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:56 2022] GET /compute/v2.1/servers/91497a0b-092d-4fba-81be-ad4b7842a79b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:40:56.309400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:56.319996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:56.323458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:56.325941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c88a93df-0694-4d7a-8cf6-885d0283daea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1598 microversion: 2.20 time: 0.308036 May 31 14:40:56.326521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 152/299] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:40:56 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1598 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:40:56.344568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:56.345069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:56.351957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.352599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.353527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:56.354280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:56.566010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6f285746-94d6-41c0-a840-ddd9f70b0df3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.226254 May 31 14:40:56.566929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 148/300] 10.222.0.67 () {60 vars in 1315 bytes} [Tue May 31 14:40:56 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:40:56.996894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:56.997689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:57.006023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:57.006479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:57.009663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:57.010131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:57.394748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:57.414209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e14dce21-2cc6-4082-ba26-431750bb57e9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.423448 May 31 14:40:57.424462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 153/301] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:56 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:58.431826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:58.432429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:58.445236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:58.445686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:58.448113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:58.448564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:58.468706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-1d3a0bf3-764a-40ea-b681-4fff23a1a035 req-476298a3-2344-4f0f-b23a-565385f90d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:40:58.481820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-1d3a0bf3-764a-40ea-b681-4fff23a1a035 req-476298a3-2344-4f0f-b23a-565385f90d02 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:58.483461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-1d3a0bf3-764a-40ea-b681-4fff23a1a035 req-476298a3-2344-4f0f-b23a-565385f90d02 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:58.517997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-1d3a0bf3-764a-40ea-b681-4fff23a1a035 req-476298a3-2344-4f0f-b23a-565385f90d02 service nova] Creating event network-changed:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:40:58.526747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-1d3a0bf3-764a-40ea-b681-4fff23a1a035 req-476298a3-2344-4f0f-b23a-565385f90d02 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066319 May 31 14:40:58.527769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 154/302] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:40:58.762721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:40:58.780230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6dff80ae-23bb-444c-8b16-d1dcf5979bbe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.352429 May 31 14:40:58.781855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 149/303] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:58 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:40:59.798991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:40:59.800289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:40:59.816129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:59.823610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:59.824438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:40:59.824880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:40:59.830204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:00.169742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:00.189681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-31722b9d-1ad9-4fef-9aeb-1d3209b992f3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.395347 May 31 14:41:00.191758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 155/304] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:40:59 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:01.210429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:01.211072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:01.222441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:01.227014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:01.227014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:01.227014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:01.539616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:01.543296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:01.554707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ed2cf7e3-d690-4620-a6a2-d033c253daf1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.349537 May 31 14:41:01.555293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 150/305] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:01 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:02.572109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:02.575820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:02.583395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:02.584266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:02.585229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:02.585894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:02.792272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:02.802449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f70ebd43-6e6b-4d0e-94ef-f068a1b65ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.234054 May 31 14:41:02.803430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 156/306] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:02 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:03.829555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:03.831939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:03.847819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:03.848916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:03.850903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:03.852007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.173791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:04.190948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ec095510-328f-4541-8a6b-44a62a56c1d7 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1501 microversion: 2.1 time: 0.368186 May 31 14:41:04.203208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 151/307] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:03 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:04.221456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9949eaf8-6863-4b66-bb4a-f498e02df8a0"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:04.223065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:04.232051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.232524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.233309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.233959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.272876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] HTTP exception thrown: Cannot 'attach_volume' instance d93b6401-2207-4636-98d0-f2e324cc2879 while it is in vm_state rescued May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Request method failure captured: May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/os-volume_attachments HTTP/1.1 May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 74 May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihz74qgYbWKOKMDJpVjs9clMr1LvvYU8wB_ciSSpX9dmBCQbpw34ItsQO8_6xFqRYlqkHfby81T6Bl8p_28n-oFolQk_ujXPDU2mOLpeFPtPm4D-Okb2Bw5S1g2iG0ZWUusennQWft0fvpasFwxd3GhPaH6IXEvEIvuakyUi6yRxbM May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:41:04.278121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c940479079b46cf82136117f62c3f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 91255c0b2d914ef9be10eb69d7d8ed4f May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {"volumeAttachment": {"volumeId": "9949eaf8-6863-4b66-bb4a-f498e02df8a0"}} May 31 14:41:04.279453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Cannot 'attach_volume' instance d93b6401-2207-4636-98d0-f2e324cc2879 while it is in vm_state rescued May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'server_id': 'd93b6401-2207-4636-98d0-f2e324cc2879', 'body': {'volumeAttachment': {'volumeId': '9949eaf8-6863-4b66-bb4a-f498e02df8a0'}}} May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d93b6401-2207-4636-98d0-f2e324cc2879 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:41:04.280494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d93b6401-2207-4636-98d0-f2e324cc2879 while it is in vm_state rescued May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:41:04.282196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d93b6401-2207-4636-98d0-f2e324cc2879 while it is in vm_state rescued May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Returning 409 to user: Cannot 'attach_volume' instance d93b6401-2207-4636-98d0-f2e324cc2879 while it is in vm_state rescued {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:41:04.283682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-34f02488-ecce-4fe3-a0a8-7bac250f1fb3 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065610 May 31 14:41:04.287746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 157/308] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:41:04 2022] POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 31 14:41:04.293807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:04.294435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:04.303437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.303698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.304337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.304782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.449528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-382d57c9-d18b-4b2f-86c6-049d11f96d06 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/action" status: 202 len: 0 microversion: 2.1 time: 0.158937 May 31 14:41:04.453940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 152/309] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:41:04 2022] POST /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:41:04.472482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:04.473310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:04.495230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.495770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.500438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:04.500971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:04.806150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:04.816440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f43a6f0-10af-431f-bfbd-3aa90fbc2515 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.359617 May 31 14:41:04.817061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 158/310] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:04 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:05.838370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:05.840374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:05.863050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:05.864825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:05.867313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:05.871951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:06.190744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:06.198852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d8d1b52-bbc0-4a45-983d-c71c820b2aa2 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.367593 May 31 14:41:06.199565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 153/311] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:05 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:06.753769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e743c0f1-6ff5-4922-a2f5-37c4e966fe09 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Action: 'create', calling method: .version_select at 0x7f8dbffd35e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1514972060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAup0yqZiZW+mBwuVOue4sNcxppTpUZZwhtXME9XlZ/SXbIAM9qnFVMcsSCjKxsNy6t9AattWXn9b23I4zDV3G6hMqVsnAm2Nl4cxw2U9VLO7EgdpXl1A2inm6eYR/QCrw=="}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:06.758799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=66 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:06.775484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-e743c0f1-6ff5-4922-a2f5-37c4e966fe09 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for project 21c11689a303465495b9209f70dfb664. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:41:06.780298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-e743c0f1-6ff5-4922-a2f5-37c4e966fe09 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for user 95d4208cdd30408bae5bcdc4d9941cde and project 21c11689a303465495b9209f70dfb664. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:41:06.811668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e743c0f1-6ff5-4922-a2f5-37c4e966fe09 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.251664 May 31 14:41:06.812262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 159/312] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 14:41:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:41:07.219711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:07.221423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:07.225029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:07.233016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:07.234755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:07.235821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:07.236862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:07.438308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:07.447081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-33ba9ffd-5326-4df0-b414-a7418876e58b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.232843 May 31 14:41:07.447675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 154/313] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:07 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:08.475768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:08.476409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:08.483092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:08.483565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:08.484946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:08.485385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:08.618788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:08.626452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-37ea25d9-36e3-4bef-aade-c2d8d75523fb tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.155125 May 31 14:41:08.627066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 160/314] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:08 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:09.644383 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:09.645114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:09.651084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:09.651532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:09.652289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:09.653451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:09.794610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:09.802355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f0ac0ac2-d44c-4355-ae54-e498e59c413e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.162711 May 31 14:41:09.802948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 155/315] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:09 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:41:10.833731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:10.834543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:10.849259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:10.849966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:10.851170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:10.851729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:11.043041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:11.052313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-064e32f6-be6e-4018-aacd-b8f0ac7f3703 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.235819 May 31 14:41:11.053114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 161/316] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:10 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:12.069793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:12.070372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:12.076520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:12.076970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:12.077733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:12.078171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:12.228046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:12.236860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2772ab8f-7240-48cc-b9dd-d6a7a2127dd9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1509 microversion: 2.1 time: 0.170931 May 31 14:41:12.237432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 156/317] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:12 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:13.254147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:13.254917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:13.261141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:13.261587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:13.262341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:13.262937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:13.399450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:13.406926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c20ceb27-8218-4281-b252-9fd9b47a1bc1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1515 microversion: 2.1 time: 0.156803 May 31 14:41:13.407495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 162/318] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:13 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:21.155193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-11648ad2-adfc-4b0c-a0f0-6e4ec0a19807 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: .version_select at 0x7f8dc41d0dc0>, body: {"keypair": {"name": "tempest-keypair-1827652100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzAWrLcSkX3wXltiywq/E7VKISsdCmqulupVnZOwDjK13Dlakngvrvnzd0ko4UEDHTiqIkTRNojr2mN/UavPJ4Qc+P5kzWekG9ncEzx+ZBjQn5+wcnkfOw4QKPPdNOZkA=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:21.169237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-11648ad2-adfc-4b0c-a0f0-6e4ec0a19807 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for project 8c940479079b46cf82136117f62c3f1a. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:41:21.173917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-11648ad2-adfc-4b0c-a0f0-6e4ec0a19807 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for user 91255c0b2d914ef9be10eb69d7d8ed4f and project 8c940479079b46cf82136117f62c3f1a. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:41:21.198368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-11648ad2-adfc-4b0c-a0f0-6e4ec0a19807 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047203 May 31 14:41:21.199013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 157/319] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 14:41:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:41:22.846388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-908922896", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "991fbe80-727a-44d7-bded-1bc6e2dba3d5"}], "security_groups": [{"name": "tempest-securitygroup--862704172"}], "key_name": "tempest-keypair-1827652100", "user_data": "}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:22.854549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:22.952408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] validate_networks() for [('991fbe80-727a-44d7-bded-1bc6e2dba3d5', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:41:23.339713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:41:23.340133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:41:23.340609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:41:23.341014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:41:23.341450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:41:23.350930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:23.351376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:23.352172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:23.352598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:23.369594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:41:23.373560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Getting quotas for user 91255c0b2d914ef9be10eb69d7d8ed4f and project 8c940479079b46cf82136117f62c3f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:41:23.384854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:41:23.387844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:41:23.436459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-47262e21-d6b5-481f-8774-861e6382ab94 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.595116 May 31 14:41:23.437353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 163/320] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:41:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 14:41:23.445337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:23.449913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-01f87160-7dcd-48d9-bd7f-a9e8cba5df87 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:23.450527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-01f87160-7dcd-48d9-bd7f-a9e8cba5df87 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:23.513045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-01f87160-7dcd-48d9-bd7f-a9e8cba5df87 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:23.520589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-01f87160-7dcd-48d9-bd7f-a9e8cba5df87 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1245 microversion: 2.1 time: 0.076222 May 31 14:41:23.521163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 158/321] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:23 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:24.538834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:24.539353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:24.545365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:24.546355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:24.547127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:24.547558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:24.611035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:24.618467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-87086da1-d635-4b31-99e2-8306758c6dfe tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1249 microversion: 2.1 time: 0.084097 May 31 14:41:24.619068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 164/322] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:24 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:25.635863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:25.636475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:25.643381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:25.643829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:25.644612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:25.645072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:25.706655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:25.714111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d84cfc8f-83fb-4a4d-9f76-451c07f9cb55 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1249 microversion: 2.1 time: 0.082079 May 31 14:41:25.714694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 159/323] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:25 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:26.730746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:26.731366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:26.739319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:26.739768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:26.740577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:26.740966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:26.809384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:26.821393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bdeb2520-6a44-44bb-af7c-dada4673eb4b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1249 microversion: 2.1 time: 0.094195 May 31 14:41:26.822263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 165/324] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:26 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:27.844169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:27.845468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:27.851671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:27.852181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:27.854108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:27.854982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:27.921185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:27.928971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f50ec6b0-1d33-4ae7-bad6-506b926e990d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1305 microversion: 2.1 time: 0.089252 May 31 14:41:27.929548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 160/325] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:27 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:28.960366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:28.960985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:28.969119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:28.969575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:28.970345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:28.970992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:29.147991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:29.159779 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-01094a33-d60b-4268-b964-f7f1073d007a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.203147 May 31 14:41:29.167474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 166/326] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:28 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:29.782236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-7f79f6a6-816b-4869-a92c-4e655fead013 req-de747a40-2eed-4be3-9ac8-2e5e369b0f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:29.801593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-7f79f6a6-816b-4869-a92c-4e655fead013 req-de747a40-2eed-4be3-9ac8-2e5e369b0f7a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:29.802050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-7f79f6a6-816b-4869-a92c-4e655fead013 req-de747a40-2eed-4be3-9ac8-2e5e369b0f7a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:29.826099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-7f79f6a6-816b-4869-a92c-4e655fead013 req-de747a40-2eed-4be3-9ac8-2e5e369b0f7a service nova] Creating event network-changed:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:41:29.831271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-7f79f6a6-816b-4869-a92c-4e655fead013 req-de747a40-2eed-4be3-9ac8-2e5e369b0f7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055723 May 31 14:41:29.832169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 161/327] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:30.181349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:30.182397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:30.193527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:30.194582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:30.195930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:30.196674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:30.204036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=60 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:30.359637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:30.367097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0f32a272-557b-4de6-b4a9-0c1a50067677 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.192955 May 31 14:41:30.367663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 167/328] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:30 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:31.385203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:31.385894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:31.392574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:31.393023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:31.393788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:31.394223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:31.526350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:31.534359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0cf625e0-d346-4c82-b37e-0b3ef23e9b14 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.153396 May 31 14:41:31.534949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 162/329] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:31 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:32.551156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:32.551770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:32.558383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:32.558870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:32.559632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:32.560200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:32.688163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:32.695923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-db42f26b-b5ad-4832-a34f-5aa4aaae1a0d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.148621 May 31 14:41:32.696478 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 168/330] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:32 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:33.712952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:33.713568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:33.715723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:33.722247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:33.722815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:33.723654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:33.724095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:33.866948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:33.875013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e771667d-67e8-4d10-a8de-3c926f7de471 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.165951 May 31 14:41:33.875585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 163/331] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:33 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:34.892848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:34.894206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:34.896113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:34.896768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:34.903144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:34.903627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:34.904404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:34.905365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:35.043449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:35.052429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8d6aed84-713d-46d3-8bfb-191d3ea7dc7e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.164260 May 31 14:41:35.053015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 169/332] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:34 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:36.069513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:36.070129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:36.076213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:36.076869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:36.077439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:36.077871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:36.209265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:36.216560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b17c67bd-7f41-4116-a37c-a5068fa9048b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.151098 May 31 14:41:36.217652 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 164/333] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:36 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:37.234143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:37.234783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:37.236938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:37.242173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:37.242616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:37.243379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:37.243807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:37.379383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:37.387096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-60db7be0-5109-4b09-b39d-ba52daf6a63e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.157484 May 31 14:41:37.387694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 170/334] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:37 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:37.558664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-f14c02e1-801a-4502-a3df-3f8efe9796d3 req-352ce5c7-86c7-45b9-b437-19f158e1a8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "name": "network-vif-plugged", "status": "completed", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:37.562389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:37.568842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f14c02e1-801a-4502-a3df-3f8efe9796d3 req-352ce5c7-86c7-45b9-b437-19f158e1a8e8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:37.569287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f14c02e1-801a-4502-a3df-3f8efe9796d3 req-352ce5c7-86c7-45b9-b437-19f158e1a8e8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:37.581965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-f14c02e1-801a-4502-a3df-3f8efe9796d3 req-352ce5c7-86c7-45b9-b437-19f158e1a8e8 service nova] Creating event network-vif-plugged:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:41:37.586869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-f14c02e1-801a-4502-a3df-3f8efe9796d3 req-352ce5c7-86c7-45b9-b437-19f158e1a8e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032006 May 31 14:41:37.587448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 165/335] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:38.404002 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:38.404560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:38.411005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:38.411464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:38.412231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:38.412898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:38.548644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:38.556008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-79b3d226-409b-4d8d-a7eb-3ea27d380934 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.155932 May 31 14:41:38.556568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 171/336] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:38 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:39.573780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:39.574593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:39.581303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:39.581762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:39.582527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:39.583039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:39.709683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:39.717663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-428150fc-1e44-4b28-9324-01e1de670cb0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1370 microversion: 2.1 time: 0.147454 May 31 14:41:39.718228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 166/337] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:39 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:40.735384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:40.735941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:40.741952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:40.742394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:40.743180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:40.743616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:40.875910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:40.883296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b2bfeb9c-7150-4838-acef-376fabacc5ca tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1564 microversion: 2.1 time: 0.152520 May 31 14:41:40.883889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 172/338] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:40 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:40.900057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:40.900563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:40.907065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:40.907516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:40.908271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:40.908709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:40.985622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1a8c7ca9-fcf1-45b9-8b94-28dc85598a62 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089234 May 31 14:41:40.986190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 167/339] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 14:41:40 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:42.319429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-1f73072b-7e5e-42a7-99ba-3ba94d067245 req-1c4dca35-4b2d-4490-a3e0-758903d871a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:42.336819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-1f73072b-7e5e-42a7-99ba-3ba94d067245 req-1c4dca35-4b2d-4490-a3e0-758903d871a5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:42.336999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-1f73072b-7e5e-42a7-99ba-3ba94d067245 req-1c4dca35-4b2d-4490-a3e0-758903d871a5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:42.350253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-1f73072b-7e5e-42a7-99ba-3ba94d067245 req-1c4dca35-4b2d-4490-a3e0-758903d871a5 service nova] Creating event network-changed:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:41:42.355611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-1f73072b-7e5e-42a7-99ba-3ba94d067245 req-1c4dca35-4b2d-4490-a3e0-758903d871a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039812 May 31 14:41:42.356410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 173/340] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:42.432600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-467743126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514972060", "security_groups": [{"name": "tempest-secgroup-smoke-1618263723"}], "block_device_mapping_v2": [{"uuid": "ff3c2ef2-52bb-42c9-88c7-cf353024181d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2101c975-3b51-45fb-aa78-b183b734b623"}]}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:42.553014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] validate_networks() for [('2101c975-3b51-45fb-aa78-b183b734b623', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:41:43.145007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:41:43.145437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:41:43.145915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:41:43.146327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:41:43.146772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:41:43.156206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:43.156658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:43.157451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:43.157890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:43.175218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for project 21c11689a303465495b9209f70dfb664. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:41:43.179331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for user 95d4208cdd30408bae5bcdc4d9941cde and project 21c11689a303465495b9209f70dfb664. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:41:43.237266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:41:43.239387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff3c2ef2-52bb-42c9-88c7-cf353024181d',volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:41:43.386561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4a73d76e-de84-4d78-a147-77a7074d5d18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.957905 May 31 14:41:43.387253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 168/341] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:41:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:41:43.398971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-67c61b50-173d-4fbd-b2e4-a2a02e83d1f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:43.399330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-67c61b50-173d-4fbd-b2e4-a2a02e83d1f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:43.457418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-67c61b50-173d-4fbd-b2e4-a2a02e83d1f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:43.466786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-67c61b50-173d-4fbd-b2e4-a2a02e83d1f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1094 microversion: 2.1 time: 0.072652 May 31 14:41:43.467617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 174/342] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:43 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:44.483628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:44.484897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:44.492157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:44.492617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:44.493390 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:44.493833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:44.558188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:44.566731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7b0143d2-0ae4-4887-ba88-c9887b7465bb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1210 microversion: 2.1 time: 0.086891 May 31 14:41:44.567286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 169/343] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:44 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:45.583913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:45.584520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:45.591735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:45.592188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:45.592954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:45.593393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:45.733732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:45.742733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6430ba09-530b-4b0d-b5e7-e05ad98c0d84 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.162565 May 31 14:41:45.743627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 175/344] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:45 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:45.903029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-37b6eb12-7205-43df-8112-4a6354b3c35a req-01d597cf-aa3f-4edf-bf34-e49a1a409cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d740346-523e-4ed4-990e-1c31c2bd0603", "tag": "fdd3454e-22af-4738-9ba6-693b493de9de"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:45.914877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-37b6eb12-7205-43df-8112-4a6354b3c35a req-01d597cf-aa3f-4edf-bf34-e49a1a409cd0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:45.915568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-37b6eb12-7205-43df-8112-4a6354b3c35a req-01d597cf-aa3f-4edf-bf34-e49a1a409cd0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:45.935954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-37b6eb12-7205-43df-8112-4a6354b3c35a req-01d597cf-aa3f-4edf-bf34-e49a1a409cd0 service nova] Creating event network-changed:fdd3454e-22af-4738-9ba6-693b493de9de for instance 9d740346-523e-4ed4-990e-1c31c2bd0603 on hv-cinder-83979 May 31 14:41:45.941481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-37b6eb12-7205-43df-8112-4a6354b3c35a req-01d597cf-aa3f-4edf-bf34-e49a1a409cd0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 May 31 14:41:45.942375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 170/345] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:46.761050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:46.761660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:46.768816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:46.769263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:46.770020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:46.770449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:46.898061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:46.905541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-525b1751-f849-4993-9bb0-d3580c24a24d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.148354 May 31 14:41:46.906104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 176/346] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:46 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:47.921750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:47.922441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:47.928649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:47.929098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:47.929878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:47.930303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:48.065112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:48.072459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d856d690-bb1e-45db-b7cc-d86ab1660b0c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.154878 May 31 14:41:48.073036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 171/347] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:47 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:49.089276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:49.089875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:49.096411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:49.096868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:49.097623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:49.098065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:49.228251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:49.236080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b6663c0a-10bc-4982-8fb6-717cd443c9b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.150668 May 31 14:41:49.236639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 177/348] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:49 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:50.252755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:50.253369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:50.259467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:50.259920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:50.260680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:50.261121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:50.393365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:50.400736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-91a6ec9e-84b7-4f1c-96ba-861301117438 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.151901 May 31 14:41:50.401287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 172/349] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:50 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:51.418157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:51.418748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:51.425110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:51.425567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:51.426300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:51.426753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:51.555658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:51.563162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5ae9eb1a-5808-4cab-bfa8-6b66e16989ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.148906 May 31 14:41:51.563720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 178/350] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:51 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:52.579990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:52.580580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:52.586571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:52.587045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:52.587799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:52.588229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:52.719099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:52.726759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5d338339-f465-477f-9ee7-e0230b794cfe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.150386 May 31 14:41:52.727321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 173/351] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:52 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:53.743945 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:53.744551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:53.746953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:53.753123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:53.753562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:53.754310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:53.754760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:53.883146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:53.890485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f9d8ac9f-151c-4864-92e1-f086316f476a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.150427 May 31 14:41:53.891078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 179/352] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:53 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:54.907198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:54.907808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:54.909741 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:54.910393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:54.916297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:54.916748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:54.917504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:54.917942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:54.921942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=73 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:55.044046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:55.051407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2b628efe-9d63-4fc0-9494-e9cf2e13e352 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.148162 May 31 14:41:55.052035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 174/353] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:54 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:56.068080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:56.068748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:56.075131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:56.075573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:56.076318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:56.076750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:56.213338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:56.221354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2333f686-2930-46b0-97c8-98c1821f8c41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.157063 May 31 14:41:56.221843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 180/354] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:56 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:57.239658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:57.240261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:57.246211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:57.246678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:57.247431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:57.247887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:57.373694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:57.381028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e6e94118-6dd2-406a-9188-b0b57c17cc76 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.146682 May 31 14:41:57.381517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 175/355] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:57 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:57.573940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-d11115b2-0fd0-4ebd-9f9e-19bae4b0dda4 req-93b49095-5d1e-4850-ad08-4961fadff0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d740346-523e-4ed4-990e-1c31c2bd0603", "name": "network-vif-plugged", "status": "completed", "tag": "fdd3454e-22af-4738-9ba6-693b493de9de"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:41:57.583674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d11115b2-0fd0-4ebd-9f9e-19bae4b0dda4 req-93b49095-5d1e-4850-ad08-4961fadff0a8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:57.584112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d11115b2-0fd0-4ebd-9f9e-19bae4b0dda4 req-93b49095-5d1e-4850-ad08-4961fadff0a8 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:57.595834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-d11115b2-0fd0-4ebd-9f9e-19bae4b0dda4 req-93b49095-5d1e-4850-ad08-4961fadff0a8 service nova] Creating event network-vif-plugged:fdd3454e-22af-4738-9ba6-693b493de9de for instance 9d740346-523e-4ed4-990e-1c31c2bd0603 on hv-cinder-83979 May 31 14:41:57.600670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-d11115b2-0fd0-4ebd-9f9e-19bae4b0dda4 req-93b49095-5d1e-4850-ad08-4961fadff0a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 May 31 14:41:57.601258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 181/356] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:41:58.397549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:58.398197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:58.404469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:58.404924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:58.405682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:58.406123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:58.537488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:58.544958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ef6af1a3-1027-47f8-9c6f-03e6584c7ea6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.151221 May 31 14:41:58.545517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 176/357] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:58 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:41:59.563656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:41:59.564356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:41:59.570565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:59.571052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:59.571812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:41:59.572251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:41:59.701204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:41:59.708475 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fd2ed64f-836c-40d7-951e-84ca70410f72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1266 microversion: 2.1 time: 0.150375 May 31 14:41:59.709035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 182/358] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:41:59 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:00.297111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:00.297635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:00.304288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.304739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:00.305491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.305924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:00.328147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7f9710b4-6e92-476f-ae28-05893c119f5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/ips" status: 200 len: 145 microversion: 2.1 time: 0.034917 May 31 14:42:00.328685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 177/359] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 14:42:00 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:42:00.724741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:00.725352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:00.731922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.732376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:00.733140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.733584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:00.737591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=82 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:00.860465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:00.867881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-53ec667b-574b-432a-9563-8b354496e752 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1453 microversion: 2.1 time: 0.147127 May 31 14:42:00.868444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 183/360] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:00 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:00.884970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:00.885581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:00.891551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.892011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:00.892773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:00.893215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:01.024724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:01.032095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-da9ce5ee-97c6-466a-a81c-503986322e3a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1453 microversion: 2.1 time: 0.150944 May 31 14:42:01.032655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 178/361] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:00 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:02.677164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-30466e33-57c7-401b-a0d8-f852b19d1703 req-d3f8e5fd-3c00-410c-833c-7acffa0a0b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d740346-523e-4ed4-990e-1c31c2bd0603", "tag": "fdd3454e-22af-4738-9ba6-693b493de9de"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:02.685559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-30466e33-57c7-401b-a0d8-f852b19d1703 req-d3f8e5fd-3c00-410c-833c-7acffa0a0b73 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:02.686073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-30466e33-57c7-401b-a0d8-f852b19d1703 req-d3f8e5fd-3c00-410c-833c-7acffa0a0b73 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:02.696981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-30466e33-57c7-401b-a0d8-f852b19d1703 req-d3f8e5fd-3c00-410c-833c-7acffa0a0b73 service nova] Creating event network-changed:fdd3454e-22af-4738-9ba6-693b493de9de for instance 9d740346-523e-4ed4-990e-1c31c2bd0603 on hv-cinder-83979 May 31 14:42:02.702218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-30466e33-57c7-401b-a0d8-f852b19d1703 req-d3f8e5fd-3c00-410c-833c-7acffa0a0b73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029045 May 31 14:42:02.702946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 184/362] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:42:04.445138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4445d6ff-4ca2-4216-bceb-54903e99be56"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:04.446203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:04.452194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:04.452647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:04.453407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:04.453847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:04.701226 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-07c3014e-2ff6-4046-893f-b1fa46a033c0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259840 May 31 14:42:04.701904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 179/363] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:42:04 2022] POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:42:12.196246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-432d4be5-81f1-4a3f-a73f-c3680bb89114 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:12.198238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=32 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:12.203748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-432d4be5-81f1-4a3f-a73f-c3680bb89114 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:12.204199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-432d4be5-81f1-4a3f-a73f-c3680bb89114 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:12.271846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-432d4be5-81f1-4a3f-a73f-c3680bb89114 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Going to try to stop instance {{(pid=124106) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 14:42:12.313935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-432d4be5-81f1-4a3f-a73f-c3680bb89114 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action" status: 202 len: 0 microversion: 2.1 time: 0.122427 May 31 14:42:12.314542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 185/364] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:42:12 2022] POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:42:12.324104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:12.324804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:12.326769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:12.334012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:12.334499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:12.335318 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:12.335768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:12.466640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:12.475242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-23103073-f9bd-45c1-bae5-1700e226c15c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.156022 May 31 14:42:12.475796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 180/365] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:12 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:42:13.494150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:13.494876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:13.501097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:13.501537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:13.502289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:13.502747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:13.632815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:13.640682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-56c71351-0fe4-45ec-88bd-fabcdd641606 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.151870 May 31 14:42:13.641238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 186/366] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:13 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:14.658376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:14.659019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:14.665509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:14.665961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:14.666815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:14.667259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:14.800291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:14.808657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-332399db-0b8f-43e2-8104-d0b4bb96eb58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.154191 May 31 14:42:14.809224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 181/367] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:14 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:15.826495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:15.827047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:15.835589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:15.836050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:15.836826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:15.837291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:15.966472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:15.974631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9c5c782f-6bc6-411f-8aab-1b0a1dc5057f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.152007 May 31 14:42:15.975222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 187/368] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:15 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:16.991644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:16.992258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:16.999362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:16.999881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:17.000646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:17.001089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:17.127237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:17.135753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e4f79302-9b38-4611-9934-da6b9b5cf552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.147913 May 31 14:42:17.136316 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 182/369] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:16 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:42:18.152624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:18.153254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:18.159730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:18.160178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:18.160925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:18.161355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:18.287553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:18.295418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-def29d94-2579-4826-8c04-981a10b78afd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.146690 May 31 14:42:18.295990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 188/370] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:18 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:19.312542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:19.313151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:19.319737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:19.320189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:19.320948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:19.321380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:19.454912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:19.462817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9d58e893-594a-4a7e-a39d-731ff69cca3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.154378 May 31 14:42:19.463381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 183/371] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:19 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:20.480314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:20.480932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:20.487384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:20.487833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:20.488584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:20.489027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:20.614080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:20.621878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-252f8fb7-41a3-4fc1-afad-3a2ece58d438 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.145426 May 31 14:42:20.622437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 189/372] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:20 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:21.638779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:21.639398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:21.645733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:21.646181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:21.646953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:21.647388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:21.774464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:21.782288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-62ffa604-a126-4da0-8a41-98cb3504ffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1721 microversion: 2.1 time: 0.147367 May 31 14:42:21.782881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 184/373] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:21 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:22.801346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:22.802236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:22.811738 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:22.812320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:22.813304 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:22.813913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:23.178613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:23.186826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2e531e28-392e-4556-8f2c-9f7a492d3d44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1698 microversion: 2.1 time: 0.390755 May 31 14:42:23.187397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 190/374] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:22 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1698 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:23.204060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e40d716d-2584-4660-aa25-0145a5ea9a46 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:23.210732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40d716d-2584-4660-aa25-0145a5ea9a46 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:23.211187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40d716d-2584-4660-aa25-0145a5ea9a46 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:23.270887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e40d716d-2584-4660-aa25-0145a5ea9a46 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Going to try to start instance {{(pid=124107) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 14:42:23.313470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e40d716d-2584-4660-aa25-0145a5ea9a46 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action" status: 202 len: 0 microversion: 2.1 time: 0.113014 May 31 14:42:23.314076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 185/375] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:42:23 2022] POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:42:23.325022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:23.325843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:23.332191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:23.332662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:23.333426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:23.333905 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:23.479268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:23.487840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-560689f9-e82e-44b7-a94d-cbd049677903 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1707 microversion: 2.1 time: 0.168215 May 31 14:42:23.488437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 191/376] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:23 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1707 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:24.506938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:24.507651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:24.513720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:24.514162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:24.514946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:24.515373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:24.658516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:24.667298 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-755b4987-dd4d-47ff-8b56-ef4e1a835370 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1707 microversion: 2.1 time: 0.165528 May 31 14:42:24.667856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 186/377] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:24 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:25.684792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:25.685398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:25.692123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:25.692567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:25.693319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:25.693749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:25.821167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:25.829101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-499af590-d575-4b5f-8422-37390bb85eba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1711 microversion: 2.1 time: 0.148095 May 31 14:42:25.829638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 192/378] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:42:25 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1711 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:42:36.275795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:36.276349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:36.278433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=13 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:36.279117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:36.284812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:36.285263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:36.286028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:36.287081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:36.312237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7c128d73-15c5-4283-aae8-2f41beeeb0c8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/ips" status: 200 len: 150 microversion: 2.20 time: 0.040410 May 31 14:42:36.312802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 187/379] 10.222.0.67 () {60 vars in 1288 bytes} [Tue May 31 14:42:36 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:42:39.559600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:39.560237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:39.562714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=15 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:39.563366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:39.570285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:39.570957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:39.571723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:39.572154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:39.596298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lazy-loading 'flavor' on Instance uuid fa32ede9-a62b-454c-9f59-6ffb472798cf {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:42:39.857065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-49163047-d5b2-43ef-a54c-2ea612225640 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/action" status: 202 len: 0 microversion: 2.20 time: 0.303217 May 31 14:42:39.857684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 193/380] 10.222.0.67 () {62 vars in 1318 bytes} [Tue May 31 14:42:39 2022] POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 14:42:39.866784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:39.867392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:39.874859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:39.875315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:39.876068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:39.876510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:40.019921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:40.028627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:40.030128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:40.031314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d057cc99-e380-47c4-8f11-b680d89072ee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.169021 May 31 14:42:40.031869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 188/381] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:39 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:41.052568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:41.053283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:41.059647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:41.060094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:41.061110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:41.061540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:41.205112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:41.213516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:41.215030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:41.216187 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4a50c2e3-80d5-4e9c-99ae-9a46cde46bb0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.168973 May 31 14:42:41.216746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 194/382] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:41 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:42.234494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:42.235139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:42.241578 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:42.242026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:42.242818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:42.243257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:42.378629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:42.386752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:42.388170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:42.389307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5f8393a0-c3f5-4f36-8a6e-e2b9f9457423 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.158682 May 31 14:42:42.389860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 189/383] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:42 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:43.409205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:43.409741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:43.416908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:43.417358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:43.418114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:43.418575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:43.548969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:43.557529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:43.559053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:43.560207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-29df8229-1f8e-4803-84d8-bd815cfef324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.155017 May 31 14:42:43.561029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 195/384] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:43 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:44.578973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:44.579536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:44.585911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:44.586357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:44.587154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:44.587592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:44.713123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:44.720999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:44.722494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:44.723686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9fbcab4c-ac49-42b9-90c5-8aa98c416f6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.148920 May 31 14:42:44.724240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 190/385] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:44 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:45.745499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:45.746264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:45.752557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:45.753046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:45.753746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:45.754172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:45.885998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:45.894024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:45.896213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:45.897366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3317dae4-e272-4d91-9ff5-0d7d97120eb2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.155729 May 31 14:42:45.897923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 196/386] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:45 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:46.916244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:46.916793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:46.923265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:46.923700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:46.924458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:46.924894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:47.052153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:47.059997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:47.061739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:47.062921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b9459c00-0cbe-40c3-ad2a-af2932d16a70 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.150678 May 31 14:42:47.063471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 191/387] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:46 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:48.081444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:48.082037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:48.088591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:48.089040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:48.089800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:48.090233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:48.227313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:48.235217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:48.236709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:48.237870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3dab253a-1a1f-43ec-9c67-92f0b99ef9d4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.160343 May 31 14:42:48.238598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 197/388] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:48 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:49.257725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:49.258845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:49.265612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:49.266104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:49.267034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:49.267533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:49.402995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:49.411569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:49.413150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:49.414309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38bb186a-8189-4d84-8716-70a09a71bd71 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.161524 May 31 14:42:49.414907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 192/389] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:49 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:50.433372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:50.433912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:50.440739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:50.441193 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:50.441961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:50.442441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:50.571932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:50.579757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:50.581248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:50.582399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-59b568df-f862-48db-a597-f21e3da80fb1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.153087 May 31 14:42:50.582995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 198/390] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:50 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:51.600928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:51.601541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:51.608045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:51.608472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:51.609228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:51.609670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:51.738344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:51.746638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:51.748131 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:51.749259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-868753f8-c26a-4448-b2d3-cd58fed990cc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.152701 May 31 14:42:51.749802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 193/391] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:51 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:52.767664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:52.768296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:52.775155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:52.775605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:52.776364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:52.776798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:52.904030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:52.911840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:52.913336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:52.914496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bf04cd28-968a-401f-b0fc-b414f2ff9649 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.150749 May 31 14:42:52.915089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 199/392] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:52 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:53.932749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:53.933365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:53.940287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:53.940733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:53.941486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:53.941919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:54.072823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:54.080807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:54.082315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:54.084112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-956b025d-3dab-457d-b44d-ac307709e692 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.154739 May 31 14:42:54.084670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 194/393] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:53 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:55.104207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:55.104823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:55.111332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:55.111778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:55.112525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:55.112954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:55.239797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:55.247571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:55.249060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:55.250207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-41fc272d-3db6-4b38-b7bf-f6e962a07212 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.151100 May 31 14:42:55.250787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 200/394] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:55 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:56.268254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:56.268861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:56.275438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:56.275891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:56.276642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:56.277081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:56.402443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:56.410212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:56.412277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:56.413417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0599d0d2-36ed-45a5-9eb6-0ce117271e41 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.149068 May 31 14:42:56.413974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 195/395] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:56 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:57.432053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:57.432574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:57.439245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:57.439690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:57.440436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:57.440864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:57.570298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:57.578005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:57.579507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:57.580639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a8935d9d-0439-477c-9a51-26ed4c64fa96 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1743 microversion: 2.20 time: 0.152557 May 31 14:42:57.581192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 201/396] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:57 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:58.599205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:58.599803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:58.606288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:58.606761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:58.607546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:58.607978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:58.732194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:58.740421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:58.741900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:58.743064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-39cd34bf-7006-41a5-a4a8-f01edb3ecd23 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1743 microversion: 2.20 time: 0.147771 May 31 14:42:58.743605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 196/397] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:58 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:59.761189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:42:59.761738 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:42:59.768166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:59.768613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:59.769365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:59.769798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:59.902277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:59.910250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:59.911775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:42:59.912928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a4077b03-0004-45a2-a560-ce5f78f5c588 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1743 microversion: 2.20 time: 0.155703 May 31 14:42:59.913491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 202/398] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:42:59 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:42:59.940032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-2fb6b6e1-084d-4a71-bab0-40f5d1ba890f req-879b7ec0-989a-4f4c-9807-b9e91a2240a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "name": "network-vif-plugged", "status": "completed", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:42:59.949421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-2fb6b6e1-084d-4a71-bab0-40f5d1ba890f req-879b7ec0-989a-4f4c-9807-b9e91a2240a5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:42:59.950078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-2fb6b6e1-084d-4a71-bab0-40f5d1ba890f req-879b7ec0-989a-4f4c-9807-b9e91a2240a5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:42:59.961443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-2fb6b6e1-084d-4a71-bab0-40f5d1ba890f req-879b7ec0-989a-4f4c-9807-b9e91a2240a5 service nova] Creating event network-vif-plugged:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:42:59.966515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-2fb6b6e1-084d-4a71-bab0-40f5d1ba890f req-879b7ec0-989a-4f4c-9807-b9e91a2240a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030304 May 31 14:42:59.967360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 197/399] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:43:00.931051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:00.931587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:00.938362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:00.938862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:00.939623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:00.940060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:01.067736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:01.075565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:01.077064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:01.078213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5488b7f2-689f-47bf-a13a-938f6a309998 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1743 microversion: 2.20 time: 0.151160 May 31 14:43:01.078806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 203/400] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:00 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:02.097910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:02.099275 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:02.105431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:02.105880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:02.106635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:02.107100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:02.233583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:02.241977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:02.243509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:02.244659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ee9cbbf4-2ae3-4d0f-8889-213f81320fde tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1743 microversion: 2.20 time: 0.151488 May 31 14:43:02.245213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 198/401] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:02 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:03.264624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:03.265626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:03.272024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:03.272471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:03.273233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:03.273665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:03.414371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:03.422440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:03.423994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:03.425147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d7cc1fb7-33b8-49cc-ad64-af4b1c11fee6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.165937 May 31 14:43:03.425920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 204/402] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:03 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:04.446142 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:04.446852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:04.453642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:04.454382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:04.455610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:04.456320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:04.616297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:04.625042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:04.626585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:04.627973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7cfe0500-bf78-43de-8329-9e974d5ec0d7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.186553 May 31 14:43:04.628526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 199/403] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:04 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:05.650202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:05.651555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:05.660979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:05.661942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:05.665644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:05.665644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:05.840620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:05.849098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:05.850590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:05.851778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2f564490-583c-4347-a0d8-4624a7cbeacd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.206565 May 31 14:43:05.852536 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 205/404] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:05 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:06.869961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:06.870566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:06.883031 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=27 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:06.889113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:06.889567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:06.890337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:06.890802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:06.894706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=73 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:07.034166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:07.044379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:07.046292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:07.047511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0eef6813-621e-4c79-951d-05c468167ae0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.181734 May 31 14:43:07.051977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 200/405] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:06 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:08.066603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:08.067269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:08.074255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:08.074808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:08.075582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:08.076024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:08.234733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:08.248521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:08.249148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:08.252209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4073b15c-2f05-42ba-ba43-8e1f6423b4fe tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.190380 May 31 14:43:08.253202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 206/406] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:08 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:09.273515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:09.275374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:09.283553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:09.284361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:09.285541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:09.286273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:09.439671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:09.448152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:09.449648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:09.450842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-79d79729-efca-4b63-a220-9d8efeb05594 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.184155 May 31 14:43:09.451590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 201/407] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:09 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:10.472271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:10.473000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:10.476448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=29 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:10.489405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:10.489854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:10.490627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:10.491082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:10.493986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:10.633040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:10.641618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:10.643132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:10.644289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5a137f7f-a52a-4e24-9c0f-3afe2be987ea tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.176557 May 31 14:43:10.654861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 207/408] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:10 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:11.666612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:11.667344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:11.676089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:11.676638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:11.677796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:11.678499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:11.827643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:11.836528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:11.838159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:11.839470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1a2e5235-b096-4840-b4fb-a573c1ebe3bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.177266 May 31 14:43:11.840126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 202/409] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:11 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:12.234746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:12.235910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:12.242988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:12.243437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:12.244202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:12.244813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:12.532736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7c35a357-d3ee-4f2c-bd9c-a6f37d130d9d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301781 May 31 14:43:12.533348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 208/410] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:43:12 2022] POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:43:12.857253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:12.857857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:12.864909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:12.865359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:12.866117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:12.866552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:12.996088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:13.005593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:13.007674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:13.009010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-887be8f1-c77c-4e33-82db-c610d8f6930e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1738 microversion: 2.20 time: 0.155647 May 31 14:43:13.009568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 203/411] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:12 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:14.028602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:14.029302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:14.036098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:14.036556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:14.037316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:14.037756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:14.168221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:14.176041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:14.178409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:14.179584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ae91ed77-a731-4bb6-9f73-0676d4d89d6b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1720 microversion: 2.20 time: 0.155860 May 31 14:43:14.180141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 209/412] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:14 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:15.199451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:15.200147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:15.206626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:15.207103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:15.207856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:15.208287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:15.333950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:15.341723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:15.343272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:15.344404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ccded238-33df-492e-bf1f-ac4c252117aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1720 microversion: 2.20 time: 0.149299 May 31 14:43:15.344946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 204/413] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:15 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:16.003887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-d8a5d613-fce4-4f2e-86f2-191cccf07c82 req-9f3425ee-d81a-4eca-ae4f-9db046e30c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "name": "network-vif-unplugged", "status": "completed", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:16.014374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d8a5d613-fce4-4f2e-86f2-191cccf07c82 req-9f3425ee-d81a-4eca-ae4f-9db046e30c46 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.014881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d8a5d613-fce4-4f2e-86f2-191cccf07c82 req-9f3425ee-d81a-4eca-ae4f-9db046e30c46 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.026561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.compute.server_external_events [req-d8a5d613-fce4-4f2e-86f2-191cccf07c82 req-9f3425ee-d81a-4eca-ae4f-9db046e30c46 service nova] Unable to find a host for instance fa32ede9-a62b-454c-9f59-6ffb472798cf. Dropping event network-vif-unplugged {{(pid=124106) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 14:43:16.027464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-d8a5d613-fce4-4f2e-86f2-191cccf07c82 req-9f3425ee-d81a-4eca-ae4f-9db046e30c46 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029188 May 31 14:43:16.028039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 210/414] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 31 14:43:16.361776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:16.362392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:16.368918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.369374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.370138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.370583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.495174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:16.503050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:16.505079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:16.506236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ed6fe8cd-4fcd-4ec0-92c4-2cfadfb86557 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1663 microversion: 2.20 time: 0.148369 May 31 14:43:16.506832 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 205/415] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:16 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:16.524308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "254eae48-3e2e-45e4-ac2c-5c6e04193a51"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:16.525389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:16.531787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.532236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.532989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.533425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.831458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-74817161-0df6-48bc-81b2-030add5edb29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311705 May 31 14:43:16.832071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 211/416] 10.222.0.67 () {62 vars in 1363 bytes} [Tue May 31 14:43:16 2022] POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:43:16.958940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:16.959498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:16.965440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.965886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:16.966629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:16.967110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:17.059232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3348356-0b4b-4ac2-ba52-5e8b1bf9b55a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/action" status: 202 len: 0 microversion: 2.20 time: 0.104248 May 31 14:43:17.060083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 206/417] 10.222.0.67 () {62 vars in 1318 bytes} [Tue May 31 14:43:16 2022] POST /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 14:43:17.068165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:17.068934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:17.075504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:17.075950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:17.076723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:17.077158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:17.212449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:17.220731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:17.222243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:17.223949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6708e385-ba0a-4c8b-98df-30a9a7a8b219 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1749 microversion: 2.20 time: 0.159650 May 31 14:43:17.224506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 212/418] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:17 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:18.242196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:18.242845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:18.250076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:18.250557 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:18.251380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:18.251818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:18.380349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:18.389292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:18.390815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:18.391978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b4331a74-7255-4419-8700-cdd035ede20d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1751 microversion: 2.20 time: 0.154677 May 31 14:43:18.392534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 207/419] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:18 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:19.411153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:19.411793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:19.418460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:19.418947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:19.419721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:19.420161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:19.552016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:19.560645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:19.562127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:19.563294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2ae7e3c2-206b-493a-87bd-cc2ee9eb57a8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1751 microversion: 2.20 time: 0.156895 May 31 14:43:19.563845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 213/420] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:19 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:20.030943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:20.031949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:20.039299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.039853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.040631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.041078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.064081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lazy-loading 'flavor' on Instance uuid 03d95a1b-f439-4057-98da-5a7e9e863cce {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:43:20.223699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2fffc67f-397b-4188-bd1e-ad7273367347 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/action" status: 200 len: 32 microversion: 2.1 time: 0.196698 May 31 14:43:20.224309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 208/421] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:43:20 2022] POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 14:43:20.233395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:20.234004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:20.239987 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.240433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.241190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.241660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.367269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:20.375264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cfcc85b6-f698-4164-a84d-4eb054ff30c1 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.145702 May 31 14:43:20.375829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 214/422] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:20 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:20.581880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:20.582583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:20.590694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.591167 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.592123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:20.592939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:20.745105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:20.761402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:20.764221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:20.766320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-decc75bb-c731-4d30-aee4-71632a331e95 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.188439 May 31 14:43:20.767320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 209/423] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:20 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:21.393347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:21.394263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:21.402005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:21.402577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:21.403647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:21.404160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:21.537201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:21.546223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6e45a066-46cd-45a8-8fbe-9f51f7d6c9f8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.157780 May 31 14:43:21.547297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 215/424] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:21 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:21.784859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:21.785964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:21.792504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:21.792958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:21.793724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:21.794164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:21.953590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:21.963852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:21.965659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:21.966915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-67d1e780-44ad-4e51-a0e3-af3420afe0af tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.185918 May 31 14:43:21.967539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 210/425] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:21 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:22.567350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:22.569426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:22.580309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:22.581133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:22.583169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:22.584097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:22.760445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:22.768551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9c3bd06c-3cd4-4ef9-91ad-fe839b68cf02 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.207692 May 31 14:43:22.769114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 216/426] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:22 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:22.989442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:22.990849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:22.997732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:22.998413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:22.999212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:22.999653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:23.152839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:23.163894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:23.165805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:23.167114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a54a4948-4132-42b2-8887-3193c8501032 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.182928 May 31 14:43:23.167964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 211/427] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:22 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:23.791182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:23.793048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:23.799898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:23.800395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:23.801203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:23.801677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:23.961044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:23.969379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8cae40a8-7568-4fab-b605-e5b42670ecc0 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.186917 May 31 14:43:23.975805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 217/428] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:23 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:24.186434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:24.187253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:24.194764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:24.195227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:24.196039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:24.196486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:24.339881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:24.348739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:24.350228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:24.351462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eaa295e7-bc38-4272-98a7-7d28d650d1f8 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.169461 May 31 14:43:24.352215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 212/429] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:24 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:24.986530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:24.987159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:24.993662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:24.994117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:24.994897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:24.995337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:25.142422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:25.151268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2350f18e-0193-4bff-b691-fdced65fe005 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.168540 May 31 14:43:25.151847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 218/430] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:24 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:25.370210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:25.370879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:25.377398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:25.377850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:25.378614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:25.379711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:25.518357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:25.521991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:25.535117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:25.536799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:25.537980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3b66c4bb-a8db-4f57-a59f-1a0f525be71c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.171962 May 31 14:43:25.538539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 213/431] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:25 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:26.171378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:26.173019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:26.186882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:26.188077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:26.189114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:26.189756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:26.335786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:26.344948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-064c04b6-e891-4512-bc20-0c23a68d8ba9 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.178173 May 31 14:43:26.345834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 219/432] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:26 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:26.559015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:26.559924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:26.567531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:26.567975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:26.568742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:26.569264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:26.705626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:26.714979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:26.716587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:26.717842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aed1e5a9-5510-46c8-ac5c-7495b1445f4d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.164711 May 31 14:43:26.718932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 214/433] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:26 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:27.362954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:27.364109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:27.370728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:27.371184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:27.371949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:27.372389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:27.387388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:27.508570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:27.516476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-55dbf9e0-4cfe-4783-9e64-268221178b95 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.157457 May 31 14:43:27.517044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 220/434] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:27 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:27.737976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:27.739167 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:27.745536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:27.745993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:27.746799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:27.747245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:27.899026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:27.908302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:27.909864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:27.911663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-044e207c-3b59-43ac-9c19-cffac4bfb17a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.177846 May 31 14:43:27.912771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 215/435] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:27 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:28.533317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:28.533911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:28.540695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:28.541136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:28.541899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:28.542329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:28.676699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:28.684835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3682ce3f-1b4c-4ab7-8cd2-642c8151c3a8 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.155204 May 31 14:43:28.685400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 221/436] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:28 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:28.930819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:28.931556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:28.938429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:28.939048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:28.939810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:28.940240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:29.083740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:29.092152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:29.093657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:29.094859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dd439c6d-7b21-4972-a752-ce40f3af4794 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.169294 May 31 14:43:29.095415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 216/437] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:28 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:29.702522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:29.703191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:29.710110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:29.710563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:29.711357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:29.711801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:29.849957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:29.858306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dd21c36b-5637-406d-aba8-b1b50cfa6a81 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.159650 May 31 14:43:29.858906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 222/438] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:29 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:30.114975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:30.116270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:30.124026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:30.124477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:30.129401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:30.129401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:30.272607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:30.298284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:30.301746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:30.303839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-61b9e0ef-35df-4a87-87b5-6d2828e1427f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.192636 May 31 14:43:30.304968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 217/439] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:30 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:30.878079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:30.879576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:30.886395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:30.886908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:30.887674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:30.888106 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:31.023229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:31.032104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ec817fe4-61db-476a-ac4d-1cd920b98f17 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.159034 May 31 14:43:31.032677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 223/440] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:30 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:31.331289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:31.331924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:31.339078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:31.339531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:31.340289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:31.340724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:31.466692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:31.475028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:31.476527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:31.477669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d47f846-9600-424c-8697-1a2880d9f184 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.150370 May 31 14:43:31.478215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 218/441] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:31 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:32.049156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:32.049769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:32.056835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:32.057286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:32.058046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:32.058486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:32.191512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:32.199337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b857575d-746a-4f18-a718-7673c782ebed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.154016 May 31 14:43:32.199907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 224/442] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:32 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:32.496219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:32.496764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:32.503130 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:32.503576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:32.504329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:32.504762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:32.628433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:32.636685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:32.638186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:32.639383 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3045b154-abdf-4ac0-974b-05e0fc1fa712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.147079 May 31 14:43:32.639930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 219/443] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:32 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:33.216426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:33.217040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:33.223686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:33.224096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:33.224832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:33.225272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:33.355546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:33.363351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-58652396-adba-464a-afc4-2241744466c5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.150793 May 31 14:43:33.364413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 225/444] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:33 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:33.657819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:33.658420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:33.665394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:33.665840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:33.666593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:33.667058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:33.790673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:33.798868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:33.800365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:33.802036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ba5393e6-6bee-4730-804a-0393be7c5655 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.147620 May 31 14:43:33.802580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 220/445] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:33 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:34.380117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:34.380731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:34.387355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:34.387745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:34.388503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:34.388941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:34.563673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:34.571471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e8cb208c-476e-453f-b6e3-89476381e473 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.195522 May 31 14:43:34.572045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 226/446] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:34 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:34.820328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:34.820938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:34.827072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:34.827519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:34.828270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:34.828703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:35.007440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:35.016255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:35.017761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:35.018955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a2e08491-283b-40d3-b09c-fe150c6e6e72 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.202515 May 31 14:43:35.019547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 221/447] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:34 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:35.588583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:35.589230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:35.595686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:35.596138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:35.596896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:35.597335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:35.722059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:35.729944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-62e616bd-c4d1-45a7-8c64-b8f139110020 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.145266 May 31 14:43:35.730513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 227/448] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:35 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:36.038333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:36.038978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:36.045706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:36.046152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:36.046953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:36.047400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:36.180295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:36.188941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:36.190485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:36.191671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d94f0f65-fd86-4a2b-8296-281affb3944c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.157758 May 31 14:43:36.192230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 222/449] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:36 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:36.747704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:36.748318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:36.755277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:36.755723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:36.756477 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:36.756915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:36.883700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:36.891940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1a30dac8-bd72-45ec-8282-4c652bdf6320 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.148146 May 31 14:43:36.892698 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 228/450] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:36 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:37.210083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:37.210722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:37.213061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=48 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:37.218775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:37.219228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:37.219987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:37.220425 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:37.348393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:37.356687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:37.358188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:37.359379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4f50d9ce-846e-4a1a-86b8-05cadd827c98 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.153324 May 31 14:43:37.359924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 223/451] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:37 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:37.909604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:37.910270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:37.918905 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:37.919361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:37.920156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:37.920883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:38.053327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:38.061539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f8989fd1-ecce-4495-b4d1-36e1fa03236e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1734 microversion: 2.1 time: 0.155799 May 31 14:43:38.062111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 229/452] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:37 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:38.251542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:43:38.251703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:43:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:43:38.378259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:38.378886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:38.385778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:38.386222 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:38.387003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:38.387433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:38.514948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:38.523345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:38.524872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:38.526026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-806ef9f1-42a0-42b9-ae3e-83cadc0ab33a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.151636 May 31 14:43:38.526579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 224/453] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:38 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:39.080532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:39.081131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:39.088139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.088579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.089331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.089762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.222364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:39.231016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b783717d-dac5-447b-9bd5-62b978860870 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1714 microversion: 2.1 time: 0.154356 May 31 14:43:39.231582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 230/454] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:39 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:39.331822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:39.332793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:39.338737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.339197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.339964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.340428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.464759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] HTTP exception thrown: Cannot 'detach_volume' instance 03d95a1b-f439-4057-98da-5a7e9e863cce while it is in vm_state rescued May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Request method failure captured: May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments/29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e HTTP/1.1 May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilihz74qgYbWKOKMDJpVjs9clMr1LvvYU8wB_ciSSpX9dmBCQbpw34ItsQO8_6xFqRYlqkHfby81T6Bl8p_28n-oFolQk_ujXPDU2mOLpeFPtPm4D-Okb2Bw5S1g2iG0ZWUusennQWft0fvpasFwxd3GhPaH6IXEvEIvuakyUi6yRxbM May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:43:39.466754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c940479079b46cf82136117f62c3f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 91255c0b2d914ef9be10eb69d7d8ed4f May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:43:39.468359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Cannot 'detach_volume' instance 03d95a1b-f439-4057-98da-5a7e9e863cce while it is in vm_state rescued May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'server_id': '03d95a1b-f439-4057-98da-5a7e9e863cce', 'id': '29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e'} May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce in vm_state rescued. Cannot detach_volume while the instance is in this state. May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:43:39.469154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 03d95a1b-f439-4057-98da-5a7e9e863cce while it is in vm_state rescued May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 03d95a1b-f439-4057-98da-5a7e9e863cce while it is in vm_state rescued May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:43:39.470948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Returning 409 to user: Cannot 'detach_volume' instance 03d95a1b-f439-4057-98da-5a7e9e863cce while it is in vm_state rescued {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:43:39.472457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-86de7eed-e03c-4381-8841-587d6f5dd689 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments/29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e" status: 409 len: 152 microversion: 2.1 time: 0.140354 May 31 14:43:39.472457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 225/455] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 14:43:39 2022] DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments/29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 31 14:43:39.477831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:39.478388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:39.484318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.484757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.485500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.485932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.543413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:39.544844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:39.551759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.552469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.552803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4cbbde30-fac0-43c1-b746-b039c32c8f54 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/action" status: 202 len: 0 microversion: 2.1 time: 0.078776 May 31 14:43:39.553304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.553758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.554831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 231/456] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:43:39 2022] POST /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 14:43:39.562808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:39.563411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:39.570729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.571235 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.572137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:39.572612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:39.764967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:39.768299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:39.774340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:39.775996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:39.777398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5c9ecb25-a454-4cbc-84ee-962cf5b88f31 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1722 microversion: 2.1 time: 0.219062 May 31 14:43:39.777520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-48446f88-19ea-4395-9d12-490900fe3b78 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.238030 May 31 14:43:39.778174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 232/457] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:39 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:43:39.778306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 226/458] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:39 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:40.795383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:40.795906 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:40.796291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:40.796408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:40.798468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=52 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:40.803217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:40.803667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:40.803970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:40.804425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:40.804528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:40.804862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:40.805186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:40.805624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:41.013406 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:41.016365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:41.023445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:41.024963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:41.025116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-747ba02a-765f-4780-a0ed-c018d0fe6500 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1722 microversion: 2.1 time: 0.233542 May 31 14:43:41.025543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:40 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:41.026503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b08cd8bd-5eb0-4ef6-b1b3-8bb4ebea4752 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.234678 May 31 14:43:41.027126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 227/460] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:40 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:43:42.044769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:42.045474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:42.045863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:42.045973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:42.051840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.052009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.052290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:42.052397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:42.053045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.053147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.053480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:42.053580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:42.244842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:42.251638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:42.253346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:42.255537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:42.256735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a988f519-b3ab-488a-aaac-86c8b8ff50b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.215717 May 31 14:43:42.257298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 234/461] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:42 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:42.260286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0a764e89-7f3a-4e2e-b3ce-4055e12db217 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1722 microversion: 2.1 time: 0.219275 May 31 14:43:42.260840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 228/462] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:42 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:42.958499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:42.959017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:42.965952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.966248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:42.967280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:42.968102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:43.090015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lazy-loading 'services' on Instance uuid c80e99d1-9423-47b2-b602-c03b9019dc96 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:43:43.127075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:43.206908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b937f219-4cfc-43e2-9a57-6483a42ba185 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments/4445d6ff-4ca2-4216-bceb-54903e99be56" status: 202 len: 0 microversion: 2.1 time: 0.252087 May 31 14:43:43.207565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 235/463] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 14:43:42 2022] DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments/4445d6ff-4ca2-4216-bceb-54903e99be56 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:43:43.276001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:43.276814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:43.283413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:43.283858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:43.284622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:43.285058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:43.331828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:43.332612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:43.339062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:43.339599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:43.340444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:43.340952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:43.451446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:43.460124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:43.461719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:43.462941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3cd85ff6-2be8-41bf-9101-d4f743161392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.190890 May 31 14:43:43.463492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 229/464] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:43 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:43.494242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:43.502270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d7156cb4-271e-4740-8cd4-e5ca009e2890 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1722 microversion: 2.1 time: 0.228819 May 31 14:43:43.502864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 236/465] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:43 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:43:44.481247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:44.482490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:44.490314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.492062 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.493005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.493552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.509791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:44.519641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:44.520316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:44.527421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.528064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.528964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.529398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.692259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:44.702814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:44.704580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:44.705847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2042fc39-e65b-49fd-a681-ad85834a4483 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.228461 May 31 14:43:44.706478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 230/466] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:44 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:44.714555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:44.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2cba7f93-588f-432d-b5ce-13b629db037d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1728 microversion: 2.1 time: 0.207711 May 31 14:43:44.724789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 237/467] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:44 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:43:44.743757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:44.744251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:44.750890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.751387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.752057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:44.752492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:44.831330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-60492f6a-b9ce-4ad5-8957-b284d9cc16a5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091960 May 31 14:43:44.831920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 231/468] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 14:43:44 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:43:45.427397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:43:45.427620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:43:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:43:45.724680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:45.725321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:45.732052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:45.732265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:45.733029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:45.733838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:45.955544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:45.979330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:45.986535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:46.000493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6bb3ff3e-f22b-435a-94f0-839dda489445 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.279736 May 31 14:43:46.001409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 238/469] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:45 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:46.010172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-d2d304c2-32b4-48eb-91a9-fffe29ed6451 req-cfd16c9e-8eba-425c-b595-ee1bd457c5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:46.031600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-d2d304c2-32b4-48eb-91a9-fffe29ed6451 req-cfd16c9e-8eba-425c-b595-ee1bd457c5d9 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:46.032309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-d2d304c2-32b4-48eb-91a9-fffe29ed6451 req-cfd16c9e-8eba-425c-b595-ee1bd457c5d9 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:46.044070 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-d2d304c2-32b4-48eb-91a9-fffe29ed6451 req-cfd16c9e-8eba-425c-b595-ee1bd457c5d9 service nova] Creating event network-changed:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:43:46.052721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-d2d304c2-32b4-48eb-91a9-fffe29ed6451 req-cfd16c9e-8eba-425c-b595-ee1bd457c5d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046063 May 31 14:43:46.054308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 232/470] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:43:46.175411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-186bafe2-ad4b-4c2a-9fad-8d59d2a4bdd3 req-3f96bd0b-6e15-4d99-99df-7620cc36394d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "name": "network-vif-plugged", "status": "completed", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:46.184598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-186bafe2-ad4b-4c2a-9fad-8d59d2a4bdd3 req-3f96bd0b-6e15-4d99-99df-7620cc36394d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:46.185304 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-186bafe2-ad4b-4c2a-9fad-8d59d2a4bdd3 req-3f96bd0b-6e15-4d99-99df-7620cc36394d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:46.197112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-186bafe2-ad4b-4c2a-9fad-8d59d2a4bdd3 req-3f96bd0b-6e15-4d99-99df-7620cc36394d service nova] Creating event network-vif-plugged:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:43:46.202996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-186bafe2-ad4b-4c2a-9fad-8d59d2a4bdd3 req-3f96bd0b-6e15-4d99-99df-7620cc36394d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 May 31 14:43:46.203874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 239/471] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:43:46.475051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:43:46.475209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:43:46.615289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5680b838-e8f8-4a60-86e2-cdf45aec9b9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:46.622281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5680b838-e8f8-4a60-86e2-cdf45aec9b9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:46.623016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5680b838-e8f8-4a60-86e2-cdf45aec9b9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:46.657803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5680b838-e8f8-4a60-86e2-cdf45aec9b9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Going to try to stop instance {{(pid=124107) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 14:43:46.710973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5680b838-e8f8-4a60-86e2-cdf45aec9b9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action" status: 202 len: 0 microversion: 2.1 time: 0.099944 May 31 14:43:46.711681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 233/472] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:43:46 2022] POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 14:43:46.720529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:46.721329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:46.728092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:46.729293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:46.730470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:46.731171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:46.890745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:46.899107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-08a69299-b7f1-47df-92af-e65d1f7a9bb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.182779 May 31 14:43:46.908425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 240/473] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:46 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:47.022465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:47.023198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:47.029440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:47.029930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:47.030711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:47.031155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:47.158736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:47.167668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:47.169179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:47.170335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-45fe99be-5b5f-4bcc-b414-a552d3664a3d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.152723 May 31 14:43:47.170930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 234/474] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:47 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:47.916103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:47.916711 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:47.923368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:47.923818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:47.924580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:47.925044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:48.058061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:48.066071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b8e8a6b6-3e5f-44ff-9332-392532db0672 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.153725 May 31 14:43:48.066633 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 241/475] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:47 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:43:48.067548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-e0cff577-4070-46f1-967f-808043b055c6 req-5d3791ed-bf81-4604-974b-8eb7644d1903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:43:48.076059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-e0cff577-4070-46f1-967f-808043b055c6 req-5d3791ed-bf81-4604-974b-8eb7644d1903 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:48.076511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-e0cff577-4070-46f1-967f-808043b055c6 req-5d3791ed-bf81-4604-974b-8eb7644d1903 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:48.086998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-e0cff577-4070-46f1-967f-808043b055c6 req-5d3791ed-bf81-4604-974b-8eb7644d1903 service nova] Creating event network-changed:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:43:48.091937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-e0cff577-4070-46f1-967f-808043b055c6 req-5d3791ed-bf81-4604-974b-8eb7644d1903 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028199 May 31 14:43:48.092557 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 235/476] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:43:48.189739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:48.190344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:48.196720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:48.197158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:48.197900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:48.198328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:48.329948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:48.338392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:48.339928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:48.341080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-253805c1-f35c-42f9-b0ad-599c2ea3a252 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1807 microversion: 2.20 time: 0.155234 May 31 14:43:48.341631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 242/477] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:48 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:49.084811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:49.085527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:49.092044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:49.092504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:49.093283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:49.093734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:49.230972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:49.238436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8d187881-21d6-4ec7-a305-440fa68144e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.158903 May 31 14:43:49.239028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 236/478] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:49 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:49.358812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:49.359421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:49.366416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:49.366889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:49.367643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:49.368077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:49.494814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:49.503099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:49.504591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:49.505949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b23be9cb-0913-4391-b7e2-92141c56990d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1794 microversion: 2.20 time: 0.150995 May 31 14:43:49.506498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 243/479] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:43:49 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:43:50.256011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:50.256619 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:50.263134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:50.263583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:50.264338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:50.264776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:50.389064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:50.396389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-23ced1e8-7b28-411e-ac05-3b93019f23e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.144703 May 31 14:43:50.396950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 237/480] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:50 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:51.413885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:51.414412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:51.420876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:51.421318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:51.422071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:51.422505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:51.549493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:51.556866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4692e8e2-6f1f-47b2-919e-9408ac9822b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.147533 May 31 14:43:51.557436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 244/481] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:51 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:52.574094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:52.574615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:52.581337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:52.581797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:52.582567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:52.583041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:52.726596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:52.733981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37f61d38-4109-4298-8fba-fe420a976f75 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.163822 May 31 14:43:52.734539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 238/482] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:52 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:53.751054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:53.751687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:53.758865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:53.759314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:53.760068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:53.760500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:53.889079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:53.897272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3fbc9372-1de2-4c50-94e9-3782cb244743 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.150060 May 31 14:43:53.897820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 245/483] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:53 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:54.913259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:54.914525 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:54.921053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:54.921508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:54.922267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:54.922727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:55.049849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:55.057196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0e4a4cd3-2331-4ee4-b860-8af255f5a7f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.147802 May 31 14:43:55.057749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 239/484] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:54 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:56.074240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:56.074899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:56.081404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:56.081855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:56.082618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:56.083088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:56.211389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:56.218823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1255834c-7597-4366-90d3-cd38c1b51a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.148452 May 31 14:43:56.219399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 246/485] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:56 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:57.236165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:57.236809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:57.243801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:57.244258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:57.245026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:57.245468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:57.383460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:57.390905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0d469311-cdc5-4f16-a087-679f04125cb8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.158619 May 31 14:43:57.391466 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 240/486] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:57 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:58.409530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:58.410080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:58.416647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:58.417096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:58.417858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:58.418298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:58.545211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:58.552572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8e4474ce-3405-4a26-be37-3b90c990cc4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.147069 May 31 14:43:58.553164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 247/487] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:58 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:43:59.570953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:43:59.571565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:43:59.577996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:59.578443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:59.579246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:43:59.579686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:43:59.707233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:43:59.714559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f170e84c-6c4e-4a0e-89d9-a3f5ab2d87d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.148170 May 31 14:43:59.715149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 241/488] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:43:59 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:00.730842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:00.731455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:00.737917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:00.738368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:00.739153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:00.739587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:00.865683 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:00.873595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e12d1b24-24a3-483d-b9b2-4ea114188fe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.146596 May 31 14:44:00.874162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 248/489] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:00 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:01.890601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:01.891255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:01.897718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:01.898176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:01.899481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:01.899924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:02.033169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:02.042201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-98435c4f-0fc6-44ba-b1ed-5fc3d59acb2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1675 microversion: 2.1 time: 0.155404 May 31 14:44:02.043025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 242/490] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:01 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:03.060113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:03.060723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:03.067167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:03.067607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:03.068357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:03.068814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:03.197889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:03.205304 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-91b96d4f-ee96-4da9-9be6-972af0b8048e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1652 microversion: 2.1 time: 0.149334 May 31 14:44:03.205876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 249/491] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:03 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1652 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:03.221876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9f1c4fd4-6f14-4f11-bc1c-1b6c856c4ae2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:44:03.229047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f1c4fd4-6f14-4f11-bc1c-1b6c856c4ae2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:03.229503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f1c4fd4-6f14-4f11-bc1c-1b6c856c4ae2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:03.251253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9f1c4fd4-6f14-4f11-bc1c-1b6c856c4ae2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Going to try to start instance {{(pid=124107) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 14:44:03.292433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9f1c4fd4-6f14-4f11-bc1c-1b6c856c4ae2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action" status: 202 len: 0 microversion: 2.1 time: 0.074090 May 31 14:44:03.293130 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 243/492] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 14:44:03 2022] POST /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:44:03.301162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:03.301784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:03.307864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:03.308584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:03.309872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:03.310385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:03.438280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:03.446339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-717f8e68-a7cf-4e57-8f26-8545d21ce6d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1661 microversion: 2.1 time: 0.149073 May 31 14:44:03.447296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 250/493] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:03 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:04.464517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:04.465161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:04.471243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:04.471693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:04.472446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:04.472883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:04.602673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:04.609977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-090c105a-4441-4f76-bb2f-2bd7a2ece163 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1661 microversion: 2.1 time: 0.150150 May 31 14:44:04.610534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 244/494] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:04 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:05.626808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:05.627424 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:05.633911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:05.634364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:05.635155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:05.635598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:05.760454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:05.767897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-01b751b8-d7c5-41a8-853f-f40490b41875 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1665 microversion: 2.1 time: 0.144946 May 31 14:44:05.768465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 251/495] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:05 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:40.345946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:40.346565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:40.348759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=43 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:40.349400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:40.356170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:40.356628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:40.357378 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:40.357813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:40.383365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:44:40.456186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-20dd5f4b-cdad-43be-9c65-ea599c3021e8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 204 len: 0 microversion: 2.1 time: 0.113842 May 31 14:44:40.456784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 245/496] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:44:40 2022] DELETE /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:44:40.466148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:40.466811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:40.469002 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=37 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:40.469681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:40.475648 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:40.476082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:40.476850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:40.477294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:40.609754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:40.617204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a6b2a25-57d2-4735-9ba4-0d9a989c7ccb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1578 microversion: 2.1 time: 0.156035 May 31 14:44:40.617761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 252/497] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:40 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:41.635357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:41.636056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:41.642442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:41.642926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:41.643690 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:41.644144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:41.777961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:41.785827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-42a053a6-1be6-42b5-b22e-5e528bf5a02f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1578 microversion: 2.1 time: 0.154583 May 31 14:44:41.786400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 246/498] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:41 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:42.803844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:42.804455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:42.811768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:42.812222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:42.813009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:42.813450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:42.958315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:42.968766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-10ede996-1b86-47ff-9dfb-144b674658ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1578 microversion: 2.1 time: 0.168866 May 31 14:44:42.978899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 253/499] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:42 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:44:43.658189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-cf6f31e4-1f59-4249-b74b-62ebb396dcfc req-33a7b9e4-f307-466c-84e2-3d40f7262e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d740346-523e-4ed4-990e-1c31c2bd0603", "name": "network-vif-deleted", "tag": "fdd3454e-22af-4738-9ba6-693b493de9de"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:44:43.670419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-cf6f31e4-1f59-4249-b74b-62ebb396dcfc req-33a7b9e4-f307-466c-84e2-3d40f7262e85 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:43.670905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-cf6f31e4-1f59-4249-b74b-62ebb396dcfc req-33a7b9e4-f307-466c-84e2-3d40f7262e85 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:43.702601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-cf6f31e4-1f59-4249-b74b-62ebb396dcfc req-33a7b9e4-f307-466c-84e2-3d40f7262e85 service nova] Creating event network-vif-deleted:fdd3454e-22af-4738-9ba6-693b493de9de for instance 9d740346-523e-4ed4-990e-1c31c2bd0603 on hv-cinder-83979 May 31 14:44:43.708553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-cf6f31e4-1f59-4249-b74b-62ebb396dcfc req-33a7b9e4-f307-466c-84e2-3d40f7262e85 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117995 May 31 14:44:43.709922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 247/500] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:44:43.986396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:43.987918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:43.995104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:43.995903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:43.996907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:43.997570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:44.032122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:44.032726 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:44.033423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lazy-loading 'fault' on Instance uuid 9d740346-523e-4ed4-990e-1c31c2bd0603 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:44:44.080709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:44.089334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7c29ca25-b992-40ba-a1e4-1d66b5e00203 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 200 len: 1230 microversion: 2.1 time: 0.106768 May 31 14:44:44.089918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 254/501] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:43 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:45.107645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:45.108373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:45.115037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:45.115488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:45.116254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:45.116690 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:45.132930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] HTTP exception thrown: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Request method failure captured: May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 HTTP/1.1 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilij61ktRRlnDLlHoLthbTqT1lUlpU31H_bmFlexQBn7uAvCB9A4HsBvr2cQa9bG5XHD4NNOU6boGEQf-FEiaVQqCid5rMVzVB98sc-T5FhDJnyTzdCC06RaJI3iqWubmqRlGJoCQ8vKZnvR5ATudlCdoDDC2RQdt1oghtE60PZz1w3Q May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 21c11689a303465495b9209f70dfb664 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-TestVolumeBootPattern-180337677 May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:44:45.135584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/21c11689a303465495b9209f70dfb664"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_21c11689a303465495b9209f70dfb664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-TestVolumeBootPattern-180337677 May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 21c11689a303465495b9209f70dfb664 May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-TestVolumeBootPattern-180337677 May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-TestVolumeBootPattern-180337677-project May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 95d4208cdd30408bae5bcdc4d9941cde May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-TestVolumeBootPattern-180337677-project May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 14:44:45.137128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '9d740346-523e-4ed4-990e-1c31c2bd0603'} May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:44:45.138051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 14:44:45.147772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:44:45.149132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Returning 404 to user: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:44:45.149132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2575d1d1-32c6-4a24-8edf-16868b603a15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 404 len: 111 microversion: 2.1 time: 0.034119 May 31 14:44:45.149132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 248/502] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:45 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 14:44:45.186340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1645428177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514972060", "security_groups": [{"name": "tempest-secgroup-smoke-1618263723"}], "block_device_mapping_v2": [{"uuid": "ff3c2ef2-52bb-42c9-88c7-cf353024181d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2101c975-3b51-45fb-aa78-b183b734b623"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:44:45.297723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] validate_networks() for [('2101c975-3b51-45fb-aa78-b183b734b623', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:44:45.714351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:44:45.714825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:44:45.715297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:44:45.715728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:44:45.716131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:44:45.725855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:45.726296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:45.727131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:45.728259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:45.746040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for project 21c11689a303465495b9209f70dfb664. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:44:45.750273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Getting quotas for user 95d4208cdd30408bae5bcdc4d9941cde and project 21c11689a303465495b9209f70dfb664. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:44:45.811070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:44:45.813232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff3c2ef2-52bb-42c9-88c7-cf353024181d',volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:44:45.963096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9be3274a-b939-4f9c-8286-46bc11a80e1b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780584 May 31 14:44:45.963974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 255/503] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:44:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:44:45.973764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6b9acf0b-32a5-4ea6-a231-a079de686715 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:45.974490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6b9acf0b-32a5-4ea6-a231-a079de686715 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:46.030262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6b9acf0b-32a5-4ea6-a231-a079de686715 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:46.036975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6b9acf0b-32a5-4ea6-a231-a079de686715 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1095 microversion: 2.1 time: 0.067034 May 31 14:44:46.037534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 249/504] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:47.053931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:47.054575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:47.060943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:47.061395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:47.062165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:47.062607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:47.128368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:47.136125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e13cba27-f1a2-4fcf-a62f-541e7c88ef19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1211 microversion: 2.1 time: 0.086483 May 31 14:44:47.136689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 256/505] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:44:48.160304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:48.161541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:48.170261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:48.170746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:48.172224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:48.172734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:48.322022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:48.330385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e30b5abb-8b55-4eeb-a1fe-5f7b212c065a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.180725 May 31 14:44:48.330993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 250/506] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:48.370530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-5dfe0216-fc25-4c19-bb24-951feec2edf9 req-e8976aca-fa8b-4d6b-8b43-c1f856920987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83ddc26-cae5-4b25-8814-b23ca0401cfc", "tag": "6ffece83-3725-4891-bdaa-7796a0315252"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:44:48.382149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-5dfe0216-fc25-4c19-bb24-951feec2edf9 req-e8976aca-fa8b-4d6b-8b43-c1f856920987 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:48.383774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-5dfe0216-fc25-4c19-bb24-951feec2edf9 req-e8976aca-fa8b-4d6b-8b43-c1f856920987 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:48.398049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-5dfe0216-fc25-4c19-bb24-951feec2edf9 req-e8976aca-fa8b-4d6b-8b43-c1f856920987 service nova] Creating event network-changed:6ffece83-3725-4891-bdaa-7796a0315252 for instance a83ddc26-cae5-4b25-8814-b23ca0401cfc on hv-cinder-83979 May 31 14:44:48.404251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-5dfe0216-fc25-4c19-bb24-951feec2edf9 req-e8976aca-fa8b-4d6b-8b43-c1f856920987 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038356 May 31 14:44:48.404895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 257/507] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:44:49.317818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:49.318329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:49.324873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.325328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.326097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.326542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.348863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:49.349556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:49.356615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.357068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.358005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.358496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.408399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lazy-loading 'services' on Instance uuid 03d95a1b-f439-4057-98da-5a7e9e863cce {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:44:49.490359 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:49.497984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f7620461-5202-4bc6-8a6a-509a2eac4e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.153212 May 31 14:44:49.498556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 258/508] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:49.520996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cd461dc1-d5f6-4f5d-b8c4-4a20c4d9add6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments/29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e" status: 202 len: 0 microversion: 2.1 time: 0.206875 May 31 14:44:49.521615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 251/509] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 14:44:49 2022] DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments/29807db8-e4c2-46dd-b1cc-1dd7d6a5cf2e => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:44:49.530390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:49.531339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:49.537546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.538000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.538790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:49.539229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:49.568680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-25d218de-0f1e-4532-a54f-68dc19239a5b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 May 31 14:44:49.569235 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 259/510] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:44:49 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:44:50.516488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:50.517173 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:50.523287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.523734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.525191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.525625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.581495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:50.582449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:50.590463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.591021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.591795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.592231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.620642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-69e2f0b4-38e2-40a8-8c54-611d1f3b8243 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043053 May 31 14:44:50.621202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 260/511] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:44:50 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 14:44:50.663717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:50.671906 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-76386154-535f-4dc8-920b-0675072a065f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.160119 May 31 14:44:50.672464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 252/512] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:50.702391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:50.702932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:50.708909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.709358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.710112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.710546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.735941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:44:50.809198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5015a94a-534a-40fb-8f58-25246767bec5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 204 len: 0 microversion: 2.1 time: 0.110401 May 31 14:44:50.809788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 261/513] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:44:50 2022] DELETE /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:44:50.818500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:50.819144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:50.825216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.825665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.826427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:50.826894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:50.953744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:50.961153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4941199f-07d7-461e-a1b3-d8978940f004 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1688 microversion: 2.1 time: 0.147211 May 31 14:44:50.962278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 253/514] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:50 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:51.689979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:51.690702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:51.697742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:51.698194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:51.698989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:51.699427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:51.831205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:51.839206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9e908967-c2a3-423e-b906-ed1b1ac2715b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.153390 May 31 14:44:51.839773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 262/515] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:51.979065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:51.979662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:51.986102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:51.986552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:51.987339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:51.987793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:52.111858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:52.119184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-50d04448-12e1-4bfb-88ac-e603c5ae78a4 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1688 microversion: 2.1 time: 0.144118 May 31 14:44:52.119750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 254/516] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:51 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1688 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:52.856535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:52.857135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:52.863556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:52.864000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:52.864743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:52.865172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:52.996463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:53.003970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cb0526b8-bd11-4393-a6e2-9f5f1d7ca766 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.151948 May 31 14:44:53.004530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 263/517] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:53.136899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:53.137511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:53.144145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:53.144595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:53.145352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:53.145789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:53.276600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:53.283947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-56985ba2-3973-4675-bd59-75951f7f8b4e tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1688 microversion: 2.1 time: 0.151242 May 31 14:44:53.284500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 255/518] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:53 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:54.021041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:54.021673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:54.029482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:54.029942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:54.030760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:54.031198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:54.163560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:54.171458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3789387c-e40e-4922-a324-de949e41d2b2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.154366 May 31 14:44:54.172020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 264/519] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:54.301417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:54.301991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:54.309248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:54.309691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:54.310439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:54.310898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:54.439882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:54.447556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b3c7af5-2f71-4cd9-bd32-5550975e379a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1688 microversion: 2.1 time: 0.149998 May 31 14:44:54.448217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 256/520] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:54 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:55.189414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:55.190140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:55.198083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:55.198732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:55.199602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:55.200031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:55.333308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:55.341265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bf122f65-e11b-4270-b96a-b80aa1a98f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.156008 May 31 14:44:55.341842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 265/521] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:55.447674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-5fbcd4e6-f3bd-4c7b-8ced-6cb9011ecd52 req-6c9ef026-90de-49c8-a856-f46684d03a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d95a1b-f439-4057-98da-5a7e9e863cce", "name": "network-vif-deleted", "tag": "b5d6928c-1605-4bb1-868d-942e97941a0d"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:44:55.456254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-5fbcd4e6-f3bd-4c7b-8ced-6cb9011ecd52 req-6c9ef026-90de-49c8-a856-f46684d03a72 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:55.456788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-5fbcd4e6-f3bd-4c7b-8ced-6cb9011ecd52 req-6c9ef026-90de-49c8-a856-f46684d03a72 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:55.464953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:55.465574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:55.468915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-5fbcd4e6-f3bd-4c7b-8ced-6cb9011ecd52 req-6c9ef026-90de-49c8-a856-f46684d03a72 service nova] Creating event network-vif-deleted:b5d6928c-1605-4bb1-868d-942e97941a0d for instance 03d95a1b-f439-4057-98da-5a7e9e863cce on hv-cinder-83979 May 31 14:44:55.472252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:55.472712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:55.473509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:55.473951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:55.474148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-5fbcd4e6-f3bd-4c7b-8ced-6cb9011ecd52 req-6c9ef026-90de-49c8-a856-f46684d03a72 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 May 31 14:44:55.474932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 257/522] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:44:55.539204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:55.547715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a251ff1-a75f-46b3-a7c3-79dfcaba54ad tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 200 len: 1621 microversion: 2.1 time: 0.087105 May 31 14:44:55.548623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 266/523] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:55 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 1621 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:56.358101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.358867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:56.362346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:56.366684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.367510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.368688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.369203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.505478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:56.513939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-69239cc2-21c3-435a-805c-3f03558c0de3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.159983 May 31 14:44:56.514428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 258/524] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:56.565128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.565751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 03d95a1b-f439-4057-98da-5a7e9e863cce] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:56.567712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:56.568378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:56.575479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.575941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.576712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.577153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.591271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] HTTP exception thrown: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Request method failure captured: May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce HTTP/1.1 May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihz74qgYbWKOKMDJpVjs9clMr1LvvYU8wB_ciSSpX9dmBCQbpw34ItsQO8_6xFqRYlqkHfby81T6Bl8p_28n-oFolQk_ujXPDU2mOLpeFPtPm4D-Okb2Bw5S1g2iG0ZWUusennQWft0fvpasFwxd3GhPaH6IXEvEIvuakyUi6yRxbM May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:44:56.592900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c940479079b46cf82136117f62c3f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 91255c0b2d914ef9be10eb69d7d8ed4f May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. May 31 14:44:56.594362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '03d95a1b-f439-4057-98da-5a7e9e863cce'} May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:44:56.595244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. May 31 14:44:56.596446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:44:56.597452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Returning 404 to user: Instance 03d95a1b-f439-4057-98da-5a7e9e863cce could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:44:56.597452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-31f401bc-cf7e-4a19-b0e7-97ee16a0564a tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce" status: 404 len: 111 microversion: 2.1 time: 0.033127 May 31 14:44:56.597452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 267/525] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:56 2022] GET /compute/v2.1/servers/03d95a1b-f439-4057-98da-5a7e9e863cce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:44:56.603079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ff0f1419-8a73-44d6-85af-6c30c364ed09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '.version_select at 0x7f8dbf6e6b80>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.623832 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ff0f1419-8a73-44d6-85af-6c30c364ed09 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827652100" status: 202 len: 0 microversion: 2.1 time: 0.024407 May 31 14:44:56.624418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 259/526] 10.222.0.67 () {58 vars in 1220 bytes} [Tue May 31 14:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827652100 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:44:56.701744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.702237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:56.708249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.708703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.709460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.709893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.727239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:56.739337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-78431fad-e2b4-4853-8139-e0450723757f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments/254eae48-3e2e-45e4-ac2c-5c6e04193a51" status: 200 len: 194 microversion: 2.20 time: 0.041463 May 31 14:44:56.739936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 268/527] 10.222.0.67 () {60 vars in 1453 bytes} [Tue May 31 14:44:56 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments/254eae48-3e2e-45e4-ac2c-5c6e04193a51 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:44:56.814935 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.815425 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:56.822021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.822473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.823267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:56.823705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:56.904027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lazy-loading 'services' on Instance uuid fa32ede9-a62b-454c-9f59-6ffb472798cf {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:44:56.983308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ee1c64d8-cb28-4e82-8e18-0bb8596b3a20 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments/254eae48-3e2e-45e4-ac2c-5c6e04193a51" status: 202 len: 0 microversion: 2.20 time: 0.172000 May 31 14:44:56.983902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 260/528] 10.222.0.67 () {60 vars in 1456 bytes} [Tue May 31 14:44:56 2022] DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments/254eae48-3e2e-45e4-ac2c-5c6e04193a51 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 31 14:44:56.995009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:56.996384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:57.004118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:57.005621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:57.006434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:57.007271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:57.046337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-273105a0-4717-4907-8b1e-e4a4bd2db8f9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057816 May 31 14:44:57.047123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 269/529] 10.222.0.67 () {60 vars in 1342 bytes} [Tue May 31 14:44:56 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:44:57.531808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:57.532554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:57.541834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:57.542387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:57.543457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:57.544057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:57.694078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:57.701624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2de3165d-742b-4e5b-88bc-650b073be0b3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.174134 May 31 14:44:57.702194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 261/530] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:58.057605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:58.058809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:58.065341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.065786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.066545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.067003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.095972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a3755863-53a1-4f70-aa54-c51dc3f7e934 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042310 May 31 14:44:58.096527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 270/531] 10.222.0.67 () {60 vars in 1342 bytes} [Tue May 31 14:44:58 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:58.153566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:58.154066 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:58.160138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.160626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.161389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.161861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.180764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:44:58.191799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:44:58.281592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bf133b64-bdb1-4506-95f1-db4dc8d6f119 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 204 len: 0 microversion: 2.20 time: 0.132003 May 31 14:44:58.282817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 262/532] 10.222.0.67 () {60 vars in 1279 bytes} [Tue May 31 14:44:58 2022] DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 14:44:58.291417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:58.292022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:58.298314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.298802 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.299555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.299982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.434044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:58.442635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:58.444409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:58.445716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4b309132-7061-4ada-a628-550e2c462257 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.158154 May 31 14:44:58.446781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 271/533] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:44:58 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:44:58.719122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:58.719845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:58.726343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.727336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.728107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:58.728551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:58.863474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:58.871616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c59489a4-693a-4393-9469-bed67e9abf36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.156746 May 31 14:44:58.872195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 263/534] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:58 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:59.464850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:59.465385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:59.471953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.472403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.473168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.473607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.540775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:59.541281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:59.547681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.548124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.548904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.549344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.575033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:44:59.603868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:59.612257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:59.613993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:59.615333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-88591eb9-4d1d-4db6-90b5-ca12fcbe7d14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.154924 May 31 14:44:59.626597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 272/535] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:44:59 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:44:59.652443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fcc03e65-b8ee-4ff7-99f1-6981d11f9dc5 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 204 len: 0 microversion: 2.1 time: 0.115909 May 31 14:44:59.653028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 264/536] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:44:59 2022] DELETE /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 14:44:59.660938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:59.661553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:59.668140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.668590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.669353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.669795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.798894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:44:59.806292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-af1a1019-4eba-4245-8263-e6d2806b23b6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1508 microversion: 2.1 time: 0.149157 May 31 14:44:59.806883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 273/537] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:59 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:44:59.888331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:44:59.889025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:44:59.895408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.895860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:44:59.896637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:44:59.897074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:00.028218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:00.035623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e9ff3f97-d54f-476b-adda-8891bb37a18b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.151486 May 31 14:45:00.036185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 265/538] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:44:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:00.513533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-7114931b-4290-4198-84b2-6fb3d66dd00f req-799c9c3f-e249-450b-83ad-5bddf767dc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83ddc26-cae5-4b25-8814-b23ca0401cfc", "name": "network-vif-plugged", "status": "completed", "tag": "6ffece83-3725-4891-bdaa-7796a0315252"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:00.522840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-7114931b-4290-4198-84b2-6fb3d66dd00f req-799c9c3f-e249-450b-83ad-5bddf767dc9e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:00.523298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-7114931b-4290-4198-84b2-6fb3d66dd00f req-799c9c3f-e249-450b-83ad-5bddf767dc9e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:00.536498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-7114931b-4290-4198-84b2-6fb3d66dd00f req-799c9c3f-e249-450b-83ad-5bddf767dc9e service nova] Creating event network-vif-plugged:6ffece83-3725-4891-bdaa-7796a0315252 for instance a83ddc26-cae5-4b25-8814-b23ca0401cfc on hv-cinder-83979 May 31 14:45:00.542127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-7114931b-4290-4198-84b2-6fb3d66dd00f req-799c9c3f-e249-450b-83ad-5bddf767dc9e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090224 May 31 14:45:00.542744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 274/539] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:00.633696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:00.634337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:00.640359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:00.640809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:00.641556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:00.641990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:00.777133 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:00.785122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:00.786620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:00.787794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-137b8c54-a211-4939-9970-fcc7c85ba2d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1722 microversion: 2.20 time: 0.158097 May 31 14:45:00.788357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 266/540] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:00 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:00.824630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:00.825327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:00.831637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:00.832088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:00.832856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:00.833295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:01.053720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:01.054341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:01.061838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:01.062296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:01.063100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:01.063543 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:01.193725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:01.202201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-03521043-e8ed-4b4f-aa31-972e14a2fe7b tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1508 microversion: 2.1 time: 0.382310 May 31 14:45:01.203004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 275/541] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:00 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:01.289212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:01.296851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-40eea86f-1db7-415c-8b24-77384ecb0f62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.247332 May 31 14:45:01.297417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 267/542] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:01.807950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:01.809399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:01.816829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:01.817295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:01.818181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:01.818602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:01.884467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:01.892323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:01.893817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:01.894981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cfd49867-b82a-4819-9ee3-d276e21ce073 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1654 microversion: 2.20 time: 0.091996 May 31 14:45:01.895946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 276/543] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:01 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:02.219644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:02.220234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:02.230223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.231073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.232139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.232751 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.276574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-3e040a56-a668-4663-bd6c-bb23c4d2aa0f req-c0bad85c-324e-49ce-9305-837dbe419646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa32ede9-a62b-454c-9f59-6ffb472798cf", "name": "network-vif-deleted", "tag": "3e80ae68-bdc0-44e4-902b-dacc936a9807"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:02.293666 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3e040a56-a668-4663-bd6c-bb23c4d2aa0f req-c0bad85c-324e-49ce-9305-837dbe419646 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.294127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3e040a56-a668-4663-bd6c-bb23c4d2aa0f req-c0bad85c-324e-49ce-9305-837dbe419646 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.326834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-3e040a56-a668-4663-bd6c-bb23c4d2aa0f req-c0bad85c-324e-49ce-9305-837dbe419646 service nova] Creating event network-vif-deleted:3e80ae68-bdc0-44e4-902b-dacc936a9807 for instance fa32ede9-a62b-454c-9f59-6ffb472798cf on hv-cinder-83979 May 31 14:45:02.340570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:02.340828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-3e040a56-a668-4663-bd6c-bb23c4d2aa0f req-c0bad85c-324e-49ce-9305-837dbe419646 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069612 May 31 14:45:02.341292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 277/544] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:45:02.346407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:02.352948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-29168f97-af4a-4422-816a-08a977a4b7ed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1466 microversion: 2.1 time: 0.136695 May 31 14:45:02.354155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 268/545] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:02 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1466 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:02.356183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:02.366242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.367385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.368640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.369160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.519878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:02.527942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-73bec446-d48c-436c-8030-6d5beb6b1a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1267 microversion: 2.1 time: 0.185528 May 31 14:45:02.528508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 278/546] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:02.913720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:02.914480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:02.920853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.921242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.922012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.922446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.954734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:02.955191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:02.955645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lazy-loading 'fault' on Instance uuid fa32ede9-a62b-454c-9f59-6ffb472798cf {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:45:03.000503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.009998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.011654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.013161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a1689b41-b321-40a2-a65e-c526682398a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 200 len: 1371 microversion: 2.20 time: 0.103480 May 31 14:45:03.013771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 269/547] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:02 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:03.370056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:03.370719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:03.377551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.377997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.378798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.379230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.411099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.411548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.411989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lazy-loading 'fault' on Instance uuid 22678417-12d6-42bd-a369-7ebe301adeb1 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:45:03.453543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.465195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4d0d4826-6983-4718-bfea-fbee743b2e2d tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 200 len: 1311 microversion: 2.1 time: 0.099291 May 31 14:45:03.466526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 279/548] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:03 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:03.545227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:03.545834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:03.554093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.554634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.555637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.556503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.695074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.702998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-df5fe422-d77d-49a3-bc50-992d5a7c0857 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1454 microversion: 2.1 time: 0.161487 May 31 14:45:03.703492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 270/549] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:03.719145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:03.719782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:03.725612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.726067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.727452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:03.727882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:03.856658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:03.864214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3fe0872b-df79-45d7-a195-b524a42b03b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1454 microversion: 2.1 time: 0.148806 May 31 14:45:03.864816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 280/550] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:04.031787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:04.032404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:04.038365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.038872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.039643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.040087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.054256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf HTTP/1.1 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Openstack-Nova-Api-Version: 2.20 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:45:04.055943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 14:45:04.057402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'fa32ede9-a62b-454c-9f59-6ffb472798cf'} May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:45:04.058458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 14:45:04.060121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:04.061237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:45:04.061237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3fb3472a-9ca7-4475-95a4-b1f53216c040 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 404 len: 111 microversion: 2.20 time: 0.029642 May 31 14:45:04.061237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 271/551] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:04 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 14:45:04.066872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b361eb6b-c182-4acf-8cdd-f7cba0f86ae6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '.version_select at 0x7f8dbf5e2a60>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:04.090709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b361eb6b-c182-4acf-8cdd-f7cba0f86ae6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413640206" status: 204 len: 0 microversion: 2.20 time: 0.027606 May 31 14:45:04.091295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 281/552] 10.222.0.67 () {60 vars in 1258 bytes} [Tue May 31 14:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413640206 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 14:45:04.374312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-3e624851-5805-4fff-a94a-bf00c512a246 req-9913bf7c-a449-481b-8f26-1e7f7353d01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22678417-12d6-42bd-a369-7ebe301adeb1", "name": "network-vif-deleted", "tag": "cab65840-02e9-4e84-b48b-0355060c9c09"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:04.382412 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-3e624851-5805-4fff-a94a-bf00c512a246 req-9913bf7c-a449-481b-8f26-1e7f7353d01b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.383490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-3e624851-5805-4fff-a94a-bf00c512a246 req-9913bf7c-a449-481b-8f26-1e7f7353d01b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.394941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-3e624851-5805-4fff-a94a-bf00c512a246 req-9913bf7c-a449-481b-8f26-1e7f7353d01b service nova] Creating event network-vif-deleted:cab65840-02e9-4e84-b48b-0355060c9c09 for instance 22678417-12d6-42bd-a369-7ebe301adeb1 on hv-cinder-83979 May 31 14:45:04.399950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-3e624851-5805-4fff-a94a-bf00c512a246 req-9913bf7c-a449-481b-8f26-1e7f7353d01b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029191 May 31 14:45:04.400846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 272/553] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:04.483896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:04.484509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: 22678417-12d6-42bd-a369-7ebe301adeb1] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:04.491533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.492161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.493833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.494500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.511181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] HTTP exception thrown: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Request method failure captured: May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 HTTP/1.1 May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihz74qgYbWKOKMDJpVjs9clMr1LvvYU8wB_ciSSpX9dmBCQbpw34ItsQO8_6xFqRYlqkHfby81T6Bl8p_28n-oFolQk_ujXPDU2mOLpeFPtPm4D-Okb2Bw5S1g2iG0ZWUusennQWft0fvpasFwxd3GhPaH6IXEvEIvuakyUi6yRxbM May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:45:04.512839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c940479079b46cf82136117f62c3f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 91255c0b2d914ef9be10eb69d7d8ed4f May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. May 31 14:45:04.514182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '22678417-12d6-42bd-a369-7ebe301adeb1'} May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:45:04.514969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. May 31 14:45:04.516156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:04.517206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Returning 404 to user: Instance 22678417-12d6-42bd-a369-7ebe301adeb1 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:45:04.517206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c16ad87a-f448-48ba-ac69-27607abbfe3f tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1" status: 404 len: 111 microversion: 2.1 time: 0.034664 May 31 14:45:04.523716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:04.524302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:04.527429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 282/554] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:04 2022] GET /compute/v2.1/servers/22678417-12d6-42bd-a369-7ebe301adeb1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:45:04.530731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.531190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.531965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.532405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.559788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:45:04.653719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fc31c9f5-2d15-4cd9-8100-99695e961faa tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 204 len: 0 microversion: 2.1 time: 0.134196 May 31 14:45:04.657469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 273/555] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:45:04 2022] DELETE /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:45:04.663134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:04.663818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:04.670523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.671427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.672496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:04.673007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:04.785479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0e8ce292-4fcd-4298-98fb-def3ce2342b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: .version_select at 0x7f8dbf727af0>, body: {"keypair": {"name": "tempest-keypair-1758955175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4yvoGO3c+CPWA6FDfNzsFIRvbkiNcgiGUhTHy/jMQ4oFnaTJBUEbbltid00T6L0mQmkwD/0GFZNa4UE0NuowLNMCgXRtwsWP0oVXK9jBIZ1lQX9Awqo/TVAQMCZNl7MQ=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:04.799971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-0e8ce292-4fcd-4298-98fb-def3ce2342b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for project 502541429884445e8426837b3fd0d75e. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:45:04.803802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-0e8ce292-4fcd-4298-98fb-def3ce2342b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for user 32e6ace174a840f78c8d570719c3f631 and project 502541429884445e8426837b3fd0d75e. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:45:04.819637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:04.830816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0e8ce292-4fcd-4298-98fb-def3ce2342b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049601 May 31 14:45:04.831420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 274/556] 10.222.0.67 () {62 vars in 1199 bytes} [Tue May 31 14:45:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 31 14:45:04.900336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:04.909008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6eef4e12-f0c6-4757-a2f6-f8fa5d0d63a6 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.249884 May 31 14:45:04.914539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 283/557] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:04 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:05.777193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-0f10d22f-21a6-4430-b073-f05eeb8d6d15 req-d6136be6-c07b-4ef6-9fa7-b93fdd1e4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83ddc26-cae5-4b25-8814-b23ca0401cfc", "tag": "6ffece83-3725-4891-bdaa-7796a0315252"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:05.787238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-0f10d22f-21a6-4430-b073-f05eeb8d6d15 req-d6136be6-c07b-4ef6-9fa7-b93fdd1e4b71 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:05.787841 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-0f10d22f-21a6-4430-b073-f05eeb8d6d15 req-d6136be6-c07b-4ef6-9fa7-b93fdd1e4b71 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:05.800055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-0f10d22f-21a6-4430-b073-f05eeb8d6d15 req-d6136be6-c07b-4ef6-9fa7-b93fdd1e4b71 service nova] Creating event network-changed:6ffece83-3725-4891-bdaa-7796a0315252 for instance a83ddc26-cae5-4b25-8814-b23ca0401cfc on hv-cinder-83979 May 31 14:45:05.805515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-0f10d22f-21a6-4430-b073-f05eeb8d6d15 req-d6136be6-c07b-4ef6-9fa7-b93fdd1e4b71 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103280 May 31 14:45:05.806236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 275/558] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:05.926817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:05.927435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:05.934114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:05.934849 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:05.935635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:05.936074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:06.078221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:06.087819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-368a2bea-9d2f-42ee-aa80-115b0b44ffed tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.164936 May 31 14:45:06.088521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 284/559] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:05 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:06.840201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-926270717", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6fd330-7eff-44a3-9a38-d7eefcd25440"}], "security_groups": [{"name": "tempest-securitygroup--1986334730"}], "key_name": "tempest-keypair-1758955175", "user_data": "}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:06.944670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] validate_networks() for [('9a6fd330-7eff-44a3-9a38-d7eefcd25440', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:45:07.105850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:07.106582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:07.113220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:07.113681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:07.114531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:07.115188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:07.311320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91255c0b2d914ef9be10eb69d7d8ed4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c940479079b46cf82136117f62c3f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:07.320995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5d99f98-9e00-4336-ad30-57627ea714ef tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 200 len: 1521 microversion: 2.1 time: 0.218740 May 31 14:45:07.331320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 285/560] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:07 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:07.434807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:45:07.435231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:45:07.435702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:45:07.436105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:45:07.436513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:45:07.445540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:07.445986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:07.446804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:07.447237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:07.464568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for project 502541429884445e8426837b3fd0d75e. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:45:07.468486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Getting quotas for user 32e6ace174a840f78c8d570719c3f631 and project 502541429884445e8426837b3fd0d75e. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:45:07.479947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:45:07.482284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:45:07.526795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b2a0d262-31e6-420e-a4a9-75edd7d9aa34 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.693532 May 31 14:45:07.527446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 276/561] 10.222.0.67 () {62 vars in 1187 bytes} [Tue May 31 14:45:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 14:45:07.537494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:07.538108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:07.546734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:07.598073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:07.607405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:07.610493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:07.611743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-792bdf5a-0f98-474e-9838-ea59d6887a79 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1281 microversion: 2.20 time: 0.078259 May 31 14:45:07.612404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 286/562] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:07 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:07.713069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-b46f9bbf-8cb0-43c4-acb0-5da098e22013 req-2b032d0a-4df1-422a-b65c-e3551e405211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93b6401-2207-4636-98d0-f2e324cc2879", "name": "network-vif-deleted", "tag": "2fb762bf-8969-45fa-a3d0-4f9152e89178"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:07.727169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-b46f9bbf-8cb0-43c4-acb0-5da098e22013 req-2b032d0a-4df1-422a-b65c-e3551e405211 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:07.728106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-b46f9bbf-8cb0-43c4-acb0-5da098e22013 req-2b032d0a-4df1-422a-b65c-e3551e405211 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:07.740524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-b46f9bbf-8cb0-43c4-acb0-5da098e22013 req-2b032d0a-4df1-422a-b65c-e3551e405211 service nova] Creating event network-vif-deleted:2fb762bf-8969-45fa-a3d0-4f9152e89178 for instance d93b6401-2207-4636-98d0-f2e324cc2879 on hv-cinder-83979 May 31 14:45:07.747300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-b46f9bbf-8cb0-43c4-acb0-5da098e22013 req-2b032d0a-4df1-422a-b65c-e3551e405211 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038296 May 31 14:45:07.748233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 277/563] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:08.338660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:08.339260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] [instance: d93b6401-2207-4636-98d0-f2e324cc2879] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:08.346426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:08.346902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:08.347652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:08.348085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:08.361544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] HTTP exception thrown: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Request method failure captured: May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 HTTP/1.1 May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilihz74qgYbWKOKMDJpVjs9clMr1LvvYU8wB_ciSSpX9dmBCQbpw34ItsQO8_6xFqRYlqkHfby81T6Bl8p_28n-oFolQk_ujXPDU2mOLpeFPtPm4D-Okb2Bw5S1g2iG0ZWUusennQWft0fvpasFwxd3GhPaH6IXEvEIvuakyUi6yRxbM May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:45:08.363130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c940479079b46cf82136117f62c3f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c940479079b46cf82136117f62c3f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 8c940479079b46cf82136117f62c3f1a May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-136781241 May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 91255c0b2d914ef9be10eb69d7d8ed4f May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-ServerRescueNegativeTestJSON-136781241-project May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. May 31 14:45:08.364637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'd93b6401-2207-4636-98d0-f2e324cc2879'} May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:45:08.365534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. May 31 14:45:08.367673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:08.369050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] Returning 404 to user: Instance d93b6401-2207-4636-98d0-f2e324cc2879 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:45:08.369050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c9e30b9a-9c6d-4dac-85a1-c527d10c5229 tempest-ServerRescueNegativeTestJSON-136781241 tempest-ServerRescueNegativeTestJSON-136781241-project] 10.222.0.67 "GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879" status: 404 len: 111 microversion: 2.1 time: 0.029712 May 31 14:45:08.369050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 287/564] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:08 2022] GET /compute/v2.1/servers/d93b6401-2207-4636-98d0-f2e324cc2879 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:45:08.630628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:08.631402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:08.638258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:08.638736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:08.639498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:08.640104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:08.644505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:08.715170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:08.727764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:08.729327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:08.730462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a1533a10-089f-4b16-be44-c8bebd6ac77a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1341 microversion: 2.20 time: 0.104151 May 31 14:45:08.732104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 278/565] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:08 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1341 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:09.394224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:09.395438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:09.401492 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.402024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.402895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.403406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.433143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cd5678a6-39a4-4ca9-bd69-ecba6702ca2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042728 May 31 14:45:09.433903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 288/566] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:45:09 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 14:45:09.492822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:09.493326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:09.499430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.499883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.500662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.501107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.526716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:45:09.608606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-845f01da-b423-4e23-9e7f-689af598d7a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 204 len: 0 microversion: 2.1 time: 0.119403 May 31 14:45:09.609498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 279/567] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:45:09 2022] DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:45:09.618505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:09.619260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:09.641405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.642403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.643842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.644642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.669358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:09.750385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:09.751145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:09.758225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.758731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:09.759542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:09.759990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:10.003893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:10.012285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:10.013846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:10.015308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d373249a-e427-4ba2-95fc-4384fccd4088 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1339 microversion: 2.20 time: 0.269492 May 31 14:45:10.029298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:10.032643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 280/568] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:09 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:10.037069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ecd7bb8d-e509-40cb-aa14-5bd75f98d4d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1671 microversion: 2.1 time: 0.422825 May 31 14:45:10.037639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 289/569] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:09 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:11.033750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:11.034411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:11.041756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:11.042204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:11.043014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:11.043453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:11.055967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:11.058247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:11.067099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:11.068117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:11.068902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:11.069344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:11.276053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:11.281459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:11.286844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-92425762-444d-484f-bcab-4d15d663c171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1671 microversion: 2.1 time: 0.235125 May 31 14:45:11.288442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 290/570] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:11 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:11.299684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:11.301322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:11.302692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8ce97d10-15ff-48da-bde2-a9a617c555e5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.272876 May 31 14:45:11.303667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 281/571] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:11 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:12.306205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:12.307597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:12.322784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:12.323726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:12.329943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:12.330968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:12.331488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:12.332303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:12.333109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:12.333642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:12.350434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:12.357880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:12.578936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:12.585356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:12.590936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:12.592530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:12.593926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f631a5aa-baf2-43d9-a73d-a2fe535d56de tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.276310 May 31 14:45:12.594498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 282/572] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:12 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:12.595081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9935ff3e-95e2-4c1e-a65e-9ae7673f76e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1671 microversion: 2.1 time: 0.294063 May 31 14:45:12.599595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-f5619b2a-27ea-4aac-9d00-168c0b5f2f0d req-541227e8-dd21-4a16-8239-23cde3662611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:12.606867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 291/573] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:12 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:12.609958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f5619b2a-27ea-4aac-9d00-168c0b5f2f0d req-541227e8-dd21-4a16-8239-23cde3662611 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:12.610450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f5619b2a-27ea-4aac-9d00-168c0b5f2f0d req-541227e8-dd21-4a16-8239-23cde3662611 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:12.622059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-f5619b2a-27ea-4aac-9d00-168c0b5f2f0d req-541227e8-dd21-4a16-8239-23cde3662611 service nova] Creating event network-changed:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:45:12.627199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-f5619b2a-27ea-4aac-9d00-168c0b5f2f0d req-541227e8-dd21-4a16-8239-23cde3662611 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030977 May 31 14:45:12.627802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 283/574] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:13.613149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:13.613863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:13.615306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:13.616014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:13.621458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:13.621999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:13.622861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:13.623358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:13.628717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:13.629837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:13.630734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:13.631428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:13.789930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:13.809267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a101c569-1e9d-4854-842c-43d0461fa385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1604 microversion: 2.1 time: 0.198553 May 31 14:45:13.811144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 284/575] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:13 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:13.878348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:13.891509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:13.893229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:13.895565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c269aec1-f94c-4bdc-b884-57d32afffc83 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.286200 May 31 14:45:13.896627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 292/576] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:13 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:14.646930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-5baa0d9f-d42d-4a51-83b2-eabe3db89740 req-ee622f46-dcfa-4b99-87b5-25ee059d2073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80e99d1-9423-47b2-b602-c03b9019dc96", "name": "network-vif-deleted", "tag": "53136f2b-686f-451a-acf2-3801c8829f82"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:14.655831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-5baa0d9f-d42d-4a51-83b2-eabe3db89740 req-ee622f46-dcfa-4b99-87b5-25ee059d2073 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:14.656461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-5baa0d9f-d42d-4a51-83b2-eabe3db89740 req-ee622f46-dcfa-4b99-87b5-25ee059d2073 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:14.668552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-5baa0d9f-d42d-4a51-83b2-eabe3db89740 req-ee622f46-dcfa-4b99-87b5-25ee059d2073 service nova] Creating event network-vif-deleted:53136f2b-686f-451a-acf2-3801c8829f82 for instance c80e99d1-9423-47b2-b602-c03b9019dc96 on hv-cinder-83979 May 31 14:45:14.673513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-5baa0d9f-d42d-4a51-83b2-eabe3db89740 req-ee622f46-dcfa-4b99-87b5-25ee059d2073 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030282 May 31 14:45:14.674116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 285/577] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:14.826673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:14.827290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:14.834608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:14.835101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:14.836454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:14.836896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:14.905044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:14.914601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f3ede35b-796f-4bbf-bfcf-50743869eacf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1604 microversion: 2.1 time: 0.091031 May 31 14:45:14.915434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 293/578] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:14 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:14.917369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:14.918173 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:14.924785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:14.925350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:14.926186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:14.926759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:15.063459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:15.071963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:15.073481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:15.074726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bcdfdb8e-85bc-4c90-a7b8-0d3afce60946 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.162433 May 31 14:45:15.075194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 286/579] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:14 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:15.932651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:15.933341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:15.941759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:15.942615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:15.943716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:15.944307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:15.991019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:15.991470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:15.992673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lazy-loading 'fault' on Instance uuid c80e99d1-9423-47b2-b602-c03b9019dc96 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:45:16.043085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:16.050913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eb542d38-017a-44f0-8140-5cb1934b7a02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 200 len: 1326 microversion: 2.1 time: 0.122934 May 31 14:45:16.052659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 294/580] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:15 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:16.096868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:16.097284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:16.104681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:16.105124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:16.106062 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:16.106499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:16.258135 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:16.266881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:16.268554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:16.269717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f52496f0-fd0a-4af0-bee0-0bab83c4d7b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.181224 May 31 14:45:16.270279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 287/581] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:16 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:17.071033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:17.071644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:17.079241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:17.079700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:17.080476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:17.080946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:17.094813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 HTTP/1.1 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:45:17.096335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 14:45:17.097858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'c80e99d1-9423-47b2-b602-c03b9019dc96'} May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:45:17.098874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 14:45:17.100340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:45:17.102282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:45:17.102282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8972a58f-1ddc-4acc-b74f-4fcb2d8101e5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 404 len: 111 microversion: 2.1 time: 0.031128 May 31 14:45:17.102282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 295/582] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:17 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:45:17.107178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6bd0fde6-5152-4e11-8ab4-37c1521d2d6c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '.version_select at 0x7f8dbf60aaf0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:17.128930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6bd0fde6-5152-4e11-8ab4-37c1521d2d6c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205287452" status: 202 len: 0 microversion: 2.1 time: 0.025353 May 31 14:45:17.129455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 288/583] 10.222.0.67 () {58 vars in 1217 bytes} [Tue May 31 14:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205287452 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:45:17.290133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:17.290982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:17.299113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:17.301232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:17.302242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:17.302863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:17.451313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:17.464339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:17.466332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:17.467677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-61ffec5f-d815-4ed0-b7a3-a339a098dead tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.182127 May 31 14:45:17.468402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 296/584] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:17 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:17.805202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:17.806050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=10 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:17.811707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e46c050c-2f50-4a83-9a61-948e57e1788b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: .version_select at 0x7f8dc408d0d0>, body: {"keypair": {"name": "tempest-keypair-1420979165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl6Z/qoXhghjeaLkSXNaFxsBnyFOxOSRnMXoIQC5h3OZMWVPDesuArIVAGvwo1Jo87CXn10nvfPmiAPc60hbAl19SeXePuUjVccUENj0sRjNWWsu6CrKQdMdEpbrTCxOw=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:17.830353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-e46c050c-2f50-4a83-9a61-948e57e1788b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for project e870af07745948ffa62b2e59eb8054f4. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:45:17.834796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-e46c050c-2f50-4a83-9a61-948e57e1788b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for user a36fb9afb5d54d3493e8752bae88dd13 and project e870af07745948ffa62b2e59eb8054f4. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:45:17.868003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e46c050c-2f50-4a83-9a61-948e57e1788b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063779 May 31 14:45:17.873792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 289/585] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 14:45:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:18.486888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:18.680533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:18.681426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:18.687947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:18.688540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:18.689319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:18.689761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:18.825441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:18.833568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:18.835243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:18.837026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-63613c27-378a-4eb3-a180-9ed0dc4fda45 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.355212 May 31 14:45:18.837684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 297/586] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:18 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:19.480139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332029839", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ffe9bda-21ad-4de1-b64f-297a27f690d0"}], "security_groups": [{"name": "tempest-securitygroup--561652436"}], "key_name": "tempest-keypair-1420979165", "user_data": "}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:19.579470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] validate_networks() for [('2ffe9bda-21ad-4de1-b64f-297a27f690d0', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:45:19.862982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:19.863617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:19.870307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:19.870794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:19.871597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:19.872034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:20.005977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:45:20.006531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:45:20.007067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:45:20.008007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:45:20.008423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:45:20.018088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:20.018536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:20.019350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:20.019860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:20.035039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:20.037341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for project e870af07745948ffa62b2e59eb8054f4. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:45:20.041349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Getting quotas for user a36fb9afb5d54d3493e8752bae88dd13 and project e870af07745948ffa62b2e59eb8054f4. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:45:20.043058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:20.044555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:20.045667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5249d02b-89dd-4cee-9856-80600c0b27aa tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.186711 May 31 14:45:20.046228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 298/587] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:19 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:20.052452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:45:20.055239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:45:20.100577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-89324bc7-b5ce-4313-91e1-a9998c6cc5bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.625583 May 31 14:45:20.101268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 290/588] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:45:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:45:20.111183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0b4f91d0-6955-49d2-ae6a-ade0325deea3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:20.111793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0b4f91d0-6955-49d2-ae6a-ade0325deea3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:20.167875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0b4f91d0-6955-49d2-ae6a-ade0325deea3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:20.174914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0b4f91d0-6955-49d2-ae6a-ade0325deea3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1237 microversion: 2.1 time: 0.067554 May 31 14:45:20.175599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 299/589] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:21.064687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:21.065282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:21.071515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:21.071975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:21.072742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:21.073185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:21.192994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:21.193544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:21.200649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:21.201101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:21.201869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:21.201985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:21.202307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:21.210050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:21.211600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:21.212713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1993fe07-98d3-4658-a009-41aff1b6b4a7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.152549 May 31 14:45:21.213277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 291/590] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:21 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:21.267307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:21.275088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-aa579f6b-aa71-4d65-9a0e-bdbbb9fcaccd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1241 microversion: 2.1 time: 0.086033 May 31 14:45:21.275691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 300/591] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:22.230738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:22.231334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:22.237744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:22.238188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:22.238990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:22.239420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:22.291076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:22.291699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:22.298739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:22.299174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:22.299974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:22.300393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:22.371263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:22.378534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1a0114f-c421-4ca9-adb9-e003692e9661 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1233 microversion: 2.1 time: 0.091323 May 31 14:45:22.379127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 301/592] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:22.393002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:22.400855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:22.402359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:22.403501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2e86f267-0f0f-4200-bce9-d7440fdc9a29 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.176716 May 31 14:45:22.404058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 292/593] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:22 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:23.395541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:23.396773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:23.404022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:23.404475 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:23.405258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:23.405691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:23.421503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:23.422208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:23.431051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:23.432955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:23.433882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:23.434740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:23.497718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:23.509837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4430bcf7-a460-453c-824a-5c1f3120ad94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1233 microversion: 2.1 time: 0.118146 May 31 14:45:23.510625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 302/594] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1233 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:23.533501 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-b48a8ad7-a59c-46cc-9a86-e47c03ef436a req-8d26bdf0-762a-4a12-9cf0-1c3e2e05a788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "name": "network-vif-plugged", "status": "completed", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:23.542520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-b48a8ad7-a59c-46cc-9a86-e47c03ef436a req-8d26bdf0-762a-4a12-9cf0-1c3e2e05a788 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:23.543146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-b48a8ad7-a59c-46cc-9a86-e47c03ef436a req-8d26bdf0-762a-4a12-9cf0-1c3e2e05a788 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:23.555102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-b48a8ad7-a59c-46cc-9a86-e47c03ef436a req-8d26bdf0-762a-4a12-9cf0-1c3e2e05a788 service nova] Creating event network-vif-plugged:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:45:23.560853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-b48a8ad7-a59c-46cc-9a86-e47c03ef436a req-8d26bdf0-762a-4a12-9cf0-1c3e2e05a788 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031382 May 31 14:45:23.561547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 303/595] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:45:23.604814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:23.613254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:23.614982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:23.616098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-542ab217-24f7-4e82-97ca-1f59023983a6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.198635 May 31 14:45:23.616698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 293/596] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:23 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:45:24.528244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:24.529034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:24.535339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:24.535794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:24.536558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:24.536995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:24.609890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:24.618359 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-79cfb0ee-a6be-4e8c-8c37-f33fa01c04cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1295 microversion: 2.1 time: 0.095477 May 31 14:45:24.619276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 304/597] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:24.634061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:24.634705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:24.641325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:24.641979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:24.642799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:24.643636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:24.816022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:24.825719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:24.827656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:24.829073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d779bcc6-a242-4106-862d-dc8cc2345309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1407 microversion: 2.20 time: 0.199594 May 31 14:45:24.829865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 294/598] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:24 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:25.636728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:25.637297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:25.643757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:25.644205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:25.644980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:25.645419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:25.765156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-68f5aebf-b0c2-44c6-a646-78f05dd6922f req-f74672d2-02a1-4545-bab4-2267c792e796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7381ef0b-479e-491d-a7c3-9f32109efb1e", "tag": "220ffe71-7480-4e48-bb52-b8f0d9293ad6"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:25.775930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-68f5aebf-b0c2-44c6-a646-78f05dd6922f req-f74672d2-02a1-4545-bab4-2267c792e796 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:25.776832 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-68f5aebf-b0c2-44c6-a646-78f05dd6922f req-f74672d2-02a1-4545-bab4-2267c792e796 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:25.795447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-68f5aebf-b0c2-44c6-a646-78f05dd6922f req-f74672d2-02a1-4545-bab4-2267c792e796 service nova] Creating event network-changed:220ffe71-7480-4e48-bb52-b8f0d9293ad6 for instance 7381ef0b-479e-491d-a7c3-9f32109efb1e on hv-cinder-83979 May 31 14:45:25.802474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-68f5aebf-b0c2-44c6-a646-78f05dd6922f req-f74672d2-02a1-4545-bab4-2267c792e796 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040867 May 31 14:45:25.803699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 295/599] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:45:25.809160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:25.817788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-62155d36-73f2-4cb1-9010-3258909e0813 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.186059 May 31 14:45:25.818370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 305/600] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:25.852649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:25.854475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:25.862252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:25.862731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:25.863512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:25.864064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:26.035013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:26.044322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:26.057359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:26.059272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f3ab89c9-a446-4653-959a-15700905f656 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1599 microversion: 2.20 time: 0.213425 May 31 14:45:26.060734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 296/601] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:45:25 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:45:26.077344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:26.077846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:26.083930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:26.084379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:26.085853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:26.086292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:26.170980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f96de26-b959-47b3-b2ff-30ba9bb29d18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097506 May 31 14:45:26.171577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 306/602] 10.222.0.67 () {60 vars in 1315 bytes} [Tue May 31 14:45:26 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:45:26.835808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:26.836427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:26.843086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:26.843544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:26.844315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:26.844754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:26.977071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:26.980953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:26.986354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a0174617-1289-4688-b866-cd637bf5754c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.154868 May 31 14:45:26.986980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 297/603] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:27.824533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-459fe680-0cd2-452f-90f5-83db26da81f6 req-72b63795-9bc1-43e4-88b3-cc2d2b297333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:27.840928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-459fe680-0cd2-452f-90f5-83db26da81f6 req-72b63795-9bc1-43e4-88b3-cc2d2b297333 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:27.842699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-459fe680-0cd2-452f-90f5-83db26da81f6 req-72b63795-9bc1-43e4-88b3-cc2d2b297333 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:27.858109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-459fe680-0cd2-452f-90f5-83db26da81f6 req-72b63795-9bc1-43e4-88b3-cc2d2b297333 service nova] Creating event network-changed:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:45:27.863486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-459fe680-0cd2-452f-90f5-83db26da81f6 req-72b63795-9bc1-43e4-88b3-cc2d2b297333 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 May 31 14:45:27.864101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 307/604] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:28.005160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:28.006534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:28.015254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:28.015850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:28.016991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:28.017556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:28.180671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:28.189391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e2631bb3-c26e-493d-9cf5-7b1e9d31a236 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.189245 May 31 14:45:28.190622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 298/605] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:29.216948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:29.217662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:29.225645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:29.226601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:29.227737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:29.228276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:29.383878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:29.391347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b963b1f4-62a6-4084-b5e3-55e7d30a7b7b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.180269 May 31 14:45:29.394958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 308/606] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:30.407918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:30.408530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:30.410869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:30.411510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=10 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:30.413378 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:30.418872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:30.419257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:30.420024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:30.420457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:30.561109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:30.568752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4a1ec302-a6b3-4cbf-b4f0-7def922072bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.164570 May 31 14:45:30.569993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 299/607] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:31.587434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:31.588512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:31.590889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:31.597646 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:31.598366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:31.599419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:31.600293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:31.616889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:31.739427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:31.747264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-35d04bd2-ff42-4b97-816a-5b185225119e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.165445 May 31 14:45:31.747919 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 309/608] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:32.765042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:32.765655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:32.772354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:32.772808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:32.773575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:32.774014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:32.912590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:32.920371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2216a275-4737-445b-89d1-129a62226033 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.159168 May 31 14:45:32.920845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 300/609] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:33.567312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-ec2ec82e-f3a3-4e85-94a2-3b3bafcbc395 req-74413e84-53ac-47b3-901d-bdc328d33a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7381ef0b-479e-491d-a7c3-9f32109efb1e", "name": "network-vif-plugged", "status": "completed", "tag": "220ffe71-7480-4e48-bb52-b8f0d9293ad6"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:33.578332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-ec2ec82e-f3a3-4e85-94a2-3b3bafcbc395 req-74413e84-53ac-47b3-901d-bdc328d33a25 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:33.579175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-ec2ec82e-f3a3-4e85-94a2-3b3bafcbc395 req-74413e84-53ac-47b3-901d-bdc328d33a25 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:33.591474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-ec2ec82e-f3a3-4e85-94a2-3b3bafcbc395 req-74413e84-53ac-47b3-901d-bdc328d33a25 service nova] Creating event network-vif-plugged:220ffe71-7480-4e48-bb52-b8f0d9293ad6 for instance 7381ef0b-479e-491d-a7c3-9f32109efb1e on hv-cinder-83979 May 31 14:45:33.596552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-ec2ec82e-f3a3-4e85-94a2-3b3bafcbc395 req-74413e84-53ac-47b3-901d-bdc328d33a25 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 May 31 14:45:33.597241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 310/610] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:33.938183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:33.939011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:33.947177 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:33.947735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:33.948603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:33.949295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:34.103228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:34.111069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-32ea1a5d-46be-41a5-8ca7-6defa49ee007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.177034 May 31 14:45:34.111745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 301/611] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:35.129392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:35.130188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:35.136813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:35.137347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:35.138128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:35.138567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:35.292022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:35.300901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1b2a2856-add6-48a4-853d-85e290beb0ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1362 microversion: 2.1 time: 0.176244 May 31 14:45:35.301483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 311/612] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:36.317816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:36.318463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:36.325204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:36.325664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:36.326437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:36.326903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:36.455357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:36.463120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4633c83d-ef58-40a0-b8aa-f411717148b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1548 microversion: 2.1 time: 0.149215 May 31 14:45:36.463688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 302/613] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:36.479528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:36.480077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:36.486584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:36.487068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:36.487826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:36.488260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:36.565276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-723cece8-e7c0-4627-a79e-4fcca2b70426 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089520 May 31 14:45:36.565878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 312/614] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 14:45:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:37.693537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-59c16066-2b80-498d-8df1-150cde6fe9fc req-5ae696c7-942a-405b-9cb9-b32e1010950e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7381ef0b-479e-491d-a7c3-9f32109efb1e", "tag": "220ffe71-7480-4e48-bb52-b8f0d9293ad6"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:37.702537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-59c16066-2b80-498d-8df1-150cde6fe9fc req-5ae696c7-942a-405b-9cb9-b32e1010950e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:37.703024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-59c16066-2b80-498d-8df1-150cde6fe9fc req-5ae696c7-942a-405b-9cb9-b32e1010950e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:37.714814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-59c16066-2b80-498d-8df1-150cde6fe9fc req-5ae696c7-942a-405b-9cb9-b32e1010950e service nova] Creating event network-changed:220ffe71-7480-4e48-bb52-b8f0d9293ad6 for instance 7381ef0b-479e-491d-a7c3-9f32109efb1e on hv-cinder-83979 May 31 14:45:37.719898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-59c16066-2b80-498d-8df1-150cde6fe9fc req-5ae696c7-942a-405b-9cb9-b32e1010950e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029966 May 31 14:45:37.720516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 303/615] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:44.736147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-377486248", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "networks": [{"uuid": "6229acd9-7fc6-4e1c-b038-9fb173bd0939"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:44.743395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=57 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:44.791881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] validate_networks() for [('6229acd9-7fc6-4e1c-b038-9fb173bd0939', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:45:45.149513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:45:45.149933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:45:45.150405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:45:45.150869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:45:45.151295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:45:45.160230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:45.160611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:45.161411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:45.161845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:45.179878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Getting quotas for project 2be8689fa21847ad8239ecef2dd8dd9b. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:45:45.184312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Getting quotas for user 707bc0b9491f41a185a132107432e7af and project 2be8689fa21847ad8239ecef2dd8dd9b. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:45:45.195449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:45:45.197716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:45:45.245604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5beddf9-de0e-4258-a853-6488069d6bd8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514170 May 31 14:45:45.246304 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 313/616] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:45:45.258181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f39afccc-efb5-47e6-bd9c-b3bd1ff23228 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:45.258930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f39afccc-efb5-47e6-bd9c-b3bd1ff23228 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:45.317416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f39afccc-efb5-47e6-bd9c-b3bd1ff23228 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:45.324477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f39afccc-efb5-47e6-bd9c-b3bd1ff23228 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1213 microversion: 2.1 time: 0.071759 May 31 14:45:45.325254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 304/617] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:45 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:46.341296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:46.341910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:46.349374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:46.349824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:46.351114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:46.351549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:46.416780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:46.425705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b7340e25-7ad5-48be-aed7-eaf63631096a tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1271 microversion: 2.1 time: 0.088333 May 31 14:45:46.426290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 314/618] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:46 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:47.443668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:47.445012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:47.452416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:47.452869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:47.453635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:47.454074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:47.520991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-dec3011e-df1b-4e06-9492-7ac8a63afb1a req-b9ce465a-2121-4b86-b3fa-12f77656555e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b1e16f-22bd-4d14-b5d6-35dc1254e2f3", "tag": "2d5ce9f8-765b-4820-8b86-3fbae46c78ba"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:47.531276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-dec3011e-df1b-4e06-9492-7ac8a63afb1a req-b9ce465a-2121-4b86-b3fa-12f77656555e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:47.531726 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-dec3011e-df1b-4e06-9492-7ac8a63afb1a req-b9ce465a-2121-4b86-b3fa-12f77656555e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:47.549655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-dec3011e-df1b-4e06-9492-7ac8a63afb1a req-b9ce465a-2121-4b86-b3fa-12f77656555e service nova] Creating event network-changed:2d5ce9f8-765b-4820-8b86-3fbae46c78ba for instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 on hv-cinder-83979 May 31 14:45:47.555341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-dec3011e-df1b-4e06-9492-7ac8a63afb1a req-b9ce465a-2121-4b86-b3fa-12f77656555e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037954 May 31 14:45:47.555936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 315/619] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:45:47.607294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:47.616563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4e17bdd0-2163-4293-aa7c-65800ff4cd6f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.176135 May 31 14:45:47.617222 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 305/620] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:47 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:48.634288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:48.635014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:48.641273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:48.641718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:48.642469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:48.642929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:48.769569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:48.777480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-daeacf9f-6cc6-41e7-a380-fe999e1d22be tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.147814 May 31 14:45:48.778046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 316/621] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:48 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:49.794474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:49.795104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:49.801913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:49.802356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:49.803206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:49.803642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:49.935594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:49.942908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dd89349a-e3b7-4a2d-8b93-5d1f84ba9140 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.152645 May 31 14:45:49.943472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 306/622] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:49 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:50.960185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:50.960794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:50.967243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:50.967691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:50.968537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:50.968974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:51.097509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:51.105585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-777ff4e7-f60e-4a55-a15b-a1fd3a58f8bb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.149217 May 31 14:45:51.106145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 317/623] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:50 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:52.122607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:52.123583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:52.130454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:52.130941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:52.132320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:52.132766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:52.271030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:52.278364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9d5c4ca5-7c4a-4d82-8b0f-7c7f747d2cdc tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.159611 May 31 14:45:52.278962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 307/624] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:52 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:53.295803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:53.296453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:53.303535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:53.303986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:53.304754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:53.305191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:53.432927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:53.440229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-13f1d072-9d2b-4d1c-8afe-5c800840a38c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.148364 May 31 14:45:53.440801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 318/625] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:53 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:53.650394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-b3239342-e4c3-4652-8cfe-c72c8e802b3d req-59137e0e-829a-4d95-9f66-03f95141ba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b1e16f-22bd-4d14-b5d6-35dc1254e2f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d5ce9f8-765b-4820-8b86-3fbae46c78ba"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:53.659122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-b3239342-e4c3-4652-8cfe-c72c8e802b3d req-59137e0e-829a-4d95-9f66-03f95141ba0b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:53.659528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-b3239342-e4c3-4652-8cfe-c72c8e802b3d req-59137e0e-829a-4d95-9f66-03f95141ba0b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:53.670486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-b3239342-e4c3-4652-8cfe-c72c8e802b3d req-59137e0e-829a-4d95-9f66-03f95141ba0b service nova] Creating event network-vif-plugged:2d5ce9f8-765b-4820-8b86-3fbae46c78ba for instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 on hv-cinder-83979 May 31 14:45:53.675253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-b3239342-e4c3-4652-8cfe-c72c8e802b3d req-59137e0e-829a-4d95-9f66-03f95141ba0b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028513 May 31 14:45:53.675843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 308/626] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:54.457837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:54.458367 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:54.465348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:54.465789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:54.466541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:54.466998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:54.595481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:54.603706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-94226419-8e41-4e0b-9c66-ae97c3fcd894 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1313 microversion: 2.1 time: 0.149819 May 31 14:45:54.604284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 319/627] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:54 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:55.620524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:55.628087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:55.629555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:55.643550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:55.644010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:55.644814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:55.645271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:55.784447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:55.792330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-249d5658-b3da-4da2-ade8-1ccd41ceedd4 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1498 microversion: 2.1 time: 0.174777 May 31 14:45:55.792897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 309/628] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:55 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:56.192062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:56.192583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:56.194498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:56.195190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:56.201925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:56.202371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:56.203188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:56.203624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:56.229702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:45:56.308507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8167f90b-f246-485d-86de-3d4290a325ae tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "DELETE /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 204 len: 0 microversion: 2.1 time: 0.119912 May 31 14:45:56.309163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 320/629] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:45:56 2022] DELETE /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:45:56.317888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:56.318521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:56.324704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:56.325154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:56.325916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:56.326351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:56.452269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:56.460159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6be5425c-dd10-405e-8ce5-b193caaef5ab tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1504 microversion: 2.1 time: 0.146243 May 31 14:45:56.460724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 310/630] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:56 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:45:57.478606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:57.479241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:57.485676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:57.486125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:57.486909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:57.487347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:57.618045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:57.625671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bad2ae4a-cd1f-4e77-9ec8-b8ac86ee739f tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1504 microversion: 2.1 time: 0.152033 May 31 14:45:57.626250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 321/631] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:57 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:58.477593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-c55590b1-4df7-4851-bd32-16ef73256c8b req-196be6f8-0338-4c39-828b-52acd204d37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b1e16f-22bd-4d14-b5d6-35dc1254e2f3", "name": "network-vif-deleted", "tag": "2d5ce9f8-765b-4820-8b86-3fbae46c78ba"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:58.486354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-c55590b1-4df7-4851-bd32-16ef73256c8b req-196be6f8-0338-4c39-828b-52acd204d37d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:58.486837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-c55590b1-4df7-4851-bd32-16ef73256c8b req-196be6f8-0338-4c39-828b-52acd204d37d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:58.489517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=65 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:58.499442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-c55590b1-4df7-4851-bd32-16ef73256c8b req-196be6f8-0338-4c39-828b-52acd204d37d service nova] Creating event network-vif-deleted:2d5ce9f8-765b-4820-8b86-3fbae46c78ba for instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 on hv-cinder-83979 May 31 14:45:58.504455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-c55590b1-4df7-4851-bd32-16ef73256c8b req-196be6f8-0338-4c39-828b-52acd204d37d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 May 31 14:45:58.505057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 311/632] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:45:58.642880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:58.643414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:58.650981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:58.651434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:58.652197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:58.652636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:58.688717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:58.689169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:58.689624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lazy-loading 'fault' on Instance uuid 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:45:58.735495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:45:58.743504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-27bf9d3b-6172-45d9-a838-c791dfa4a1fb tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 200 len: 1303 microversion: 2.1 time: 0.104647 May 31 14:45:58.744070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 322/633] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:58 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:45:59.761565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:45:59.762285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:45:59.768463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:59.768909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:59.769664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:45:59.770098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:45:59.783410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] HTTP exception thrown: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Request method failure captured: May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 HTTP/1.1 May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilioXNGqGMdxgOV4RihqAr7QL_ePDV0UKL1uJFtig8DqMn-SfcZSk9qOMj-FMUquNCdQRy_MRPIexNaL7DkOj8UnlLwQeVDH6CBMh74fUIP6PbYq52uZWfgGyDoUUqJAiXH2MfdSZ9CW1jVsMHU8C7xyhM6LmD7LUq6q3JG-IVgslHHc May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 2be8689fa21847ad8239ecef2dd8dd9b May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesActionsTest-1283678776 May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:45:59.784971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesActionsTest-1283678776 May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 2be8689fa21847ad8239ecef2dd8dd9b May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesActionsTest-1283678776 May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesActionsTest-1283678776-project May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 707bc0b9491f41a185a132107432e7af May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesActionsTest-1283678776-project May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. May 31 14:45:59.786532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '04b1e16f-22bd-4d14-b5d6-35dc1254e2f3'} May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:45:59.787991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. May 31 14:45:59.789456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:45:59.791004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Returning 404 to user: Instance 04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:45:59.791004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fca5280f-85be-459b-abfa-62ec4a9b82e6 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3" status: 404 len: 111 microversion: 2.1 time: 0.029434 May 31 14:45:59.791004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 312/634] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:45:59 2022] GET /compute/v2.1/servers/04b1e16f-22bd-4d14-b5d6-35dc1254e2f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:45:59.832772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1807751354", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "networks": [{"uuid": "6229acd9-7fc6-4e1c-b038-9fb173bd0939"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:45:59.887757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] validate_networks() for [('6229acd9-7fc6-4e1c-b038-9fb173bd0939', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 14:46:00.229572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 14:46:00.229998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 14:46:00.230474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 14:46:00.230921 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 14:46:00.231389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 14:46:00.240139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:00.240588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:00.241386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:00.241824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:00.258715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Getting quotas for project 2be8689fa21847ad8239ecef2dd8dd9b. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 14:46:00.262563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Getting quotas for user 707bc0b9491f41a185a132107432e7af and project 2be8689fa21847ad8239ecef2dd8dd9b. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 14:46:00.274925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 14:46:00.277171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 14:46:00.327595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-010323f8-e43f-4ec0-92ad-3ffb0f1bcb99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498565 May 31 14:46:00.328319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 323/635] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 14:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 14:46:00.339786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-600d8e47-b1dc-4ab4-9ee5-281cc4fcb6a9 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:00.340430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-600d8e47-b1dc-4ab4-9ee5-281cc4fcb6a9 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:00.394382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-600d8e47-b1dc-4ab4-9ee5-281cc4fcb6a9 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:00.401719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-600d8e47-b1dc-4ab4-9ee5-281cc4fcb6a9 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1214 microversion: 2.1 time: 0.066502 May 31 14:46:00.402284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 313/636] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:00 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:01.420268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:01.421078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:01.430610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:01.431127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:01.432368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:01.432800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:01.504005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:01.511914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-97d92b9b-4150-4d0d-a2db-d9c835cdb963 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1272 microversion: 2.1 time: 0.096834 May 31 14:46:01.512503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 324/637] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:01 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:02.529325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:02.530080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:02.532545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=33 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:02.539423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:02.539926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:02.540703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:02.541143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:02.672122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:02.680214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7999a060-9b01-4e04-88d3-72cc4608c655 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.154794 May 31 14:46:02.680791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 314/638] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:02 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:02.809960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-276b1339-e609-4c92-bcb4-3aa2fd08a009 req-ff7e1273-4ed6-409d-a9a9-f122c7c1187e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f287847-54db-4c2b-8653-ca299b27ec27", "tag": "d23af915-527e-4e81-85e3-d4d96272a938"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:46:02.819164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-276b1339-e609-4c92-bcb4-3aa2fd08a009 req-ff7e1273-4ed6-409d-a9a9-f122c7c1187e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:02.819916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-276b1339-e609-4c92-bcb4-3aa2fd08a009 req-ff7e1273-4ed6-409d-a9a9-f122c7c1187e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:02.822757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:02.838372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-276b1339-e609-4c92-bcb4-3aa2fd08a009 req-ff7e1273-4ed6-409d-a9a9-f122c7c1187e service nova] Creating event network-changed:d23af915-527e-4e81-85e3-d4d96272a938 for instance 7f287847-54db-4c2b-8653-ca299b27ec27 on hv-cinder-83979 May 31 14:46:02.843156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-276b1339-e609-4c92-bcb4-3aa2fd08a009 req-ff7e1273-4ed6-409d-a9a9-f122c7c1187e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037276 May 31 14:46:02.843766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 325/639] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:46:03.698162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:03.698838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:03.705387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:03.705846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:03.706618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:03.707086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:03.836849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:03.844429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-da67a933-bf01-4cc8-8dcb-e93b6d425fc8 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.150843 May 31 14:46:03.844992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 315/640] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:03 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:04.863052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:04.863875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:04.870621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:04.871107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:04.871879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:04.872319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:05.007135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:05.014892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f193b95e-c1e8-47d8-b361-d8598ebb8e8c tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.156418 May 31 14:46:05.015381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 326/641] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:04 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:06.034515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:06.035168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:06.042376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:06.042867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:06.043646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:06.044088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:06.185400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:06.193444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6cc51620-1651-49b8-9ced-f0110379ae99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.164982 May 31 14:46:06.194522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 316/642] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:06 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:07.211292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:07.211885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:07.218360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:07.219175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:07.219968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:07.220572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:07.354746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:07.362071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-28bf6187-b962-466f-9e57-cf342d544433 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.154657 May 31 14:46:07.362666 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 327/643] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:07 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:08.379781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:08.380326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:08.386987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:08.387451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:08.388224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:08.388669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:08.518047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:08.525993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-48e161a0-ad4d-4074-8f2d-79155033d6e2 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.150264 May 31 14:46:08.526572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 317/644] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:08 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:09.543820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:09.544365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:09.550332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:09.550800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:09.551567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:09.551980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:09.695186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:09.702999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b7c79671-32fa-49db-b34c-fd2fe7c894f3 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.163195 May 31 14:46:09.703582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 328/645] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:09 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:09.723367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-abfd8a73-b7bd-4679-a2c8-245bd4c0a866 req-b1a8ded2-51c0-429d-bb4e-be24002658dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f287847-54db-4c2b-8653-ca299b27ec27", "name": "network-vif-plugged", "status": "completed", "tag": "d23af915-527e-4e81-85e3-d4d96272a938"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:46:09.734113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-abfd8a73-b7bd-4679-a2c8-245bd4c0a866 req-b1a8ded2-51c0-429d-bb4e-be24002658dd service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:09.734556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-abfd8a73-b7bd-4679-a2c8-245bd4c0a866 req-b1a8ded2-51c0-429d-bb4e-be24002658dd service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:09.750171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-abfd8a73-b7bd-4679-a2c8-245bd4c0a866 req-b1a8ded2-51c0-429d-bb4e-be24002658dd service nova] Creating event network-vif-plugged:d23af915-527e-4e81-85e3-d4d96272a938 for instance 7f287847-54db-4c2b-8653-ca299b27ec27 on hv-cinder-83979 May 31 14:46:09.755260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-abfd8a73-b7bd-4679-a2c8-245bd4c0a866 req-b1a8ded2-51c0-429d-bb4e-be24002658dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 May 31 14:46:09.755933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 318/646] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:46:10.720196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:10.720744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:10.722733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:10.723412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:10.731241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:10.731694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:10.732467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:10.732912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:10.862079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:10.869549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ba015949-42b5-40b5-b789-7695b6474406 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1314 microversion: 2.1 time: 0.153321 May 31 14:46:10.870115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 329/647] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:10 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:11.883936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:11.888537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:11.889250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:11.895952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:11.896403 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:11.897178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:11.897617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:12.031165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:12.039261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d877aa60-1fb5-43f6-b70f-203cda714899 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1498 microversion: 2.1 time: 0.156397 May 31 14:46:12.039854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 319/648] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:11 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:12.500353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:12.500960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:12.507613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:12.508055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:12.508820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:12.509251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:12.535778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:46:12.618112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-97f81e19-7962-4d14-b21d-c79997710b99 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 204 len: 0 microversion: 2.1 time: 0.121215 May 31 14:46:12.618889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 330/649] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:46:12 2022] DELETE /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:46:12.627454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:12.628064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:12.635556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:12.636004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:12.636764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:12.637197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:12.769811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:12.777326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e96e0dcb-886c-4c0b-8848-006deeb18c40 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1504 microversion: 2.1 time: 0.153811 May 31 14:46:12.777900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 320/650] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:12 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:13.801358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:13.802460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:13.809841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:13.810287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:13.811079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:13.811513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:13.952010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:13.959399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a2c55a3-0a91-4899-b296-ea2dca1e7f49 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1504 microversion: 2.1 time: 0.165123 May 31 14:46:13.959984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 331/651] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:13 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:14.763499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-89540b3c-2a84-4b35-ac9e-0f96b887cb77 req-d609aecb-5293-475d-9445-b2505ebf71fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f287847-54db-4c2b-8653-ca299b27ec27", "name": "network-vif-deleted", "tag": "d23af915-527e-4e81-85e3-d4d96272a938"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:46:14.773259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-89540b3c-2a84-4b35-ac9e-0f96b887cb77 req-d609aecb-5293-475d-9445-b2505ebf71fe service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:14.773802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-89540b3c-2a84-4b35-ac9e-0f96b887cb77 req-d609aecb-5293-475d-9445-b2505ebf71fe service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:14.785678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-89540b3c-2a84-4b35-ac9e-0f96b887cb77 req-d609aecb-5293-475d-9445-b2505ebf71fe service nova] Creating event network-vif-deleted:d23af915-527e-4e81-85e3-d4d96272a938 for instance 7f287847-54db-4c2b-8653-ca299b27ec27 on hv-cinder-83979 May 31 14:46:14.791125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-89540b3c-2a84-4b35-ac9e-0f96b887cb77 req-d609aecb-5293-475d-9445-b2505ebf71fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 May 31 14:46:14.791904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 321/652] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:46:14.976904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:14.977455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:14.979923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:14.985443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:14.985896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:14.988446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:14.988446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:15.022317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:15.022916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:15.023312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lazy-loading 'fault' on Instance uuid 7f287847-54db-4c2b-8653-ca299b27ec27 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:46:15.063186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707bc0b9491f41a185a132107432e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be8689fa21847ad8239ecef2dd8dd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:15.071224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7019aeb3-8fbf-4a6f-a6fd-6c801bf78925 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 200 len: 1304 microversion: 2.1 time: 0.098386 May 31 14:46:15.071795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 332/653] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:14 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:46:16.088971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:16.089667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] [instance: 7f287847-54db-4c2b-8653-ca299b27ec27] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:16.095944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:16.096399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:16.097163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:16.097600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:16.111312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] HTTP exception thrown: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Request method failure captured: May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 HTTP/1.1 May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilioXNGqGMdxgOV4RihqAr7QL_ePDV0UKL1uJFtig8DqMn-SfcZSk9qOMj-FMUquNCdQRy_MRPIexNaL7DkOj8UnlLwQeVDH6CBMh74fUIP6PbYq52uZWfgGyDoUUqJAiXH2MfdSZ9CW1jVsMHU8C7xyhM6LmD7LUq6q3JG-IVgslHHc May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 2be8689fa21847ad8239ecef2dd8dd9b May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesActionsTest-1283678776 May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:46:16.112911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2be8689fa21847ad8239ecef2dd8dd9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesActionsTest-1283678776 May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 2be8689fa21847ad8239ecef2dd8dd9b May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesActionsTest-1283678776 May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesActionsTest-1283678776-project May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 707bc0b9491f41a185a132107432e7af May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesActionsTest-1283678776-project May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. May 31 14:46:16.114552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '7f287847-54db-4c2b-8653-ca299b27ec27'} May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:46:16.116384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. May 31 14:46:16.117730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:46:16.119003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] Returning 404 to user: Instance 7f287847-54db-4c2b-8653-ca299b27ec27 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:46:16.119003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1252c841-8e99-4586-9eeb-b7c2fe15b812 tempest-VolumesActionsTest-1283678776 tempest-VolumesActionsTest-1283678776-project] 10.222.0.67 "GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27" status: 404 len: 111 microversion: 2.1 time: 0.030605 May 31 14:46:16.119003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 322/654] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:46:16 2022] GET /compute/v2.1/servers/7f287847-54db-4c2b-8653-ca299b27ec27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 14:46:54.325015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:54.325845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:54.327697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:54.328433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:54.333988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:54.334442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:54.335245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:54.335739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:54.362035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-93e5da0a-3ba8-4043-89f9-07c99f318d86 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.041408 May 31 14:46:54.362532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 333/655] 10.222.0.67 () {60 vars in 1288 bytes} [Tue May 31 14:46:54 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:46:56.373051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:46:56.373664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:56.375886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=17 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:56.376553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=45 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:46:56.382490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:56.382971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:56.383741 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:56.384211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:56.409962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lazy-loading 'flavor' on Instance uuid 78752d7e-9706-4b78-8ab7-f0e6528015b4 {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:46:56.676323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-52c50aeb-389d-42de-8566-542b3fb413e9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/action" status: 202 len: 0 microversion: 2.20 time: 0.306911 May 31 14:46:56.676953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 323/656] 10.222.0.67 () {62 vars in 1318 bytes} [Tue May 31 14:46:56 2022] POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 14:46:56.686111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:56.686754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:56.694603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:56.695239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:56.697205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:56.697885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:56.841915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:56.849788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:56.851343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:56.852508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8b36c147-9f8d-4fe5-86b6-081c1d798a2c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.170465 May 31 14:46:56.853613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 334/657] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:46:56 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:46:57.873119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:57.873818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:57.881526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:57.881997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:57.882805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:57.883252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:58.015282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:58.023635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:58.025645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:58.026833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8eb0da74-51e8-4bb9-bd05-17f3b7fc5fa2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.158815 May 31 14:46:58.027401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 324/658] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:46:57 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:46:59.047369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:46:59.047993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:46:59.054361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:59.054778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:59.056439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:46:59.056881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:46:59.200951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:59.210395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:59.212743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:46:59.214175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-34a0dddc-6d15-44cf-98e1-00b2dcff936e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.170657 May 31 14:46:59.214922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 335/659] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:46:59 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:47:00.234336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:00.234982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:00.241531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:00.241983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:00.242768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:00.243206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:00.375867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:00.385254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:00.386718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:00.387875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-78815f44-6e39-4fc9-baa3-93a4ec75b406 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.157436 May 31 14:47:00.388455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 325/660] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:00 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:01.406794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:01.407466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:01.414369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:01.414886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:01.416136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:01.416572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:01.554577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:01.562977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:01.564602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:01.565809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-69a4913d-08f5-4fa1-8d58-077e4b62ade9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.163362 May 31 14:47:01.566379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 336/661] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:01 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:02.585184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:02.585831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:02.592888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:02.593338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:02.594101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:02.594538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:02.739290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:02.747737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:02.749254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:02.750464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-df13a7a3-9e20-45ca-926e-58be0dc9d4b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.169233 May 31 14:47:02.751054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 326/662] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:02 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:03.529546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:03.530185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:03.536796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:03.537195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:03.537972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:03.538409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:03.565661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b9ecea0c-a011-4737-abb4-83794c2bb603 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/ips" status: 200 len: 146 microversion: 2.1 time: 0.040067 May 31 14:47:03.566240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 337/663] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 14:47:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:47:03.769652 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:03.770298 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:03.777444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:03.777900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:03.778709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:03.779152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:03.936807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:03.945370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:03.946981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:03.948192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-829aa796-05c9-44af-8626-85f738a70586 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.182730 May 31 14:47:03.948818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 327/664] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:03 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:04.901740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9365341-225e-4fd1-bfda-5138abca0f34"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:47:04.903063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:04.909688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:04.910133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:04.910922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:04.911354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:04.966448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:04.967136 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:04.973066 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:04.973518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:04.974287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:04.974754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:05.141102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:05.150238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:05.152078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:05.153223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c62e5d3a-8812-4e4d-8397-1fd74aed7c58 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.190879 May 31 14:47:05.169816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 328/665] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:04 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:47:05.188856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d5d3a97c-4893-4988-a316-6a21ff660d9e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290979 May 31 14:47:05.189576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 338/666] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:47:04 2022] POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:47:06.177623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:06.180593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:06.185724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:06.186175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:06.186994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:06.187430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:06.342240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:06.350740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:06.352778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:06.353953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-693c9004-4685-4ba7-a288-4f6336435d93 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.180780 May 31 14:47:06.354519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 329/667] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:06 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:07.374719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:07.375588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:07.382665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:07.383127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:07.384456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:07.384910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:07.525904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:07.534128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:07.535684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:07.536844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5bdad82b-9bdb-424f-a7ee-1290d685fc81 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.167381 May 31 14:47:07.537403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 339/668] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:07 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:08.555929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:08.556538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:08.563286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:08.563670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:08.564434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:08.564873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:08.693015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:08.701134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:08.702667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:08.703864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-21b4b6ea-d135-4356-80d7-51a9cd09c309 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.152609 May 31 14:47:08.704418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 330/669] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:08 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:09.723005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:09.723618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:09.730671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:09.731141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:09.731917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:09.732358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:09.873600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:09.882671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:09.885966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:09.887179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0f89cc72-0dd1-40c7-b655-f1fff07892d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.168378 May 31 14:47:09.887747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 340/670] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:09 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:10.908341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:10.909025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:10.916584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:10.917035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:10.917793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:10.918229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:11.060080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:11.068008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:11.069686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:11.070986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a1c4a6d6-250d-49c1-8b18-b428894bcfe9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.168432 May 31 14:47:11.071551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 331/671] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:10 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:12.090989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:12.091741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:12.098744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.099203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.099984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.100422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.172881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-7e6f1364-c22a-4cc0-9510-241a170207c0 req-3e24f6ff-6e63-4440-b065-0e4a3a7e70c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "name": "network-vif-plugged", "status": "completed", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:47:12.183729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-7e6f1364-c22a-4cc0-9510-241a170207c0 req-3e24f6ff-6e63-4440-b065-0e4a3a7e70c3 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.184189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-7e6f1364-c22a-4cc0-9510-241a170207c0 req-3e24f6ff-6e63-4440-b065-0e4a3a7e70c3 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.197015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-7e6f1364-c22a-4cc0-9510-241a170207c0 req-3e24f6ff-6e63-4440-b065-0e4a3a7e70c3 service nova] Creating event network-vif-plugged:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:47:12.203468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-7e6f1364-c22a-4cc0-9510-241a170207c0 req-3e24f6ff-6e63-4440-b065-0e4a3a7e70c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 May 31 14:47:12.204445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 332/672] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:47:12.242061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:12.252847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:12.254459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:12.255778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5eb6a21-5768-429c-aa4d-e5868fce171f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.168795 May 31 14:47:12.256425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 341/673] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:12 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:12.700045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:12.701070 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:12.707276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.707727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.708486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.708924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.740250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3d98bd3b-55bd-496e-9055-dd2fab3a10ac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 May 31 14:47:12.740799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 333/674] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:47:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:47:12.750733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:12.751231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:12.757476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.757855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.758614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:12.759076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:12.789542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-156d9f2b-db49-4259-ae54-7353a8c3997d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34" status: 200 len: 194 microversion: 2.1 time: 0.042666 May 31 14:47:12.790055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 342/675] 10.222.0.67 () {58 vars in 1412 bytes} [Tue May 31 14:47:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:47:13.274591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:13.275308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:13.282864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:13.283325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:13.284108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:13.284552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:13.428879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:13.439246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:13.440736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:13.441999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c34b58f0-dcf2-4494-ad1a-ebc8b6b79bbd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.171607 May 31 14:47:13.442597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 334/676] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:13 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:14.461310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:14.461939 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:14.468969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:14.469454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:14.470211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:14.470665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:14.615239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:14.623135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:14.624643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:14.625801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff656055-4888-4327-a385-bf65d858105b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.168493 May 31 14:47:14.626631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 343/677] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:14 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:15.171190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd3df962-9600-4093-a22d-8a19d57b7ad3"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:47:15.172259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:15.178869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:15.179333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:15.180380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:15.180819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:15.440923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab2a655e-32e1-491f-9158-40021795d36a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273577 May 31 14:47:15.441585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 335/678] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 14:47:15 2022] POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:47:15.644535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:15.645128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:15.651658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:15.652104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:15.652850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:15.653307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:15.797697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:15.808133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:15.809835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:15.811162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5a3de43-2c83-4b3d-9940-5723bd3c2e99 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.170504 May 31 14:47:15.811798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 344/679] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:15 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:16.831440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:16.832128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:16.838876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:16.839330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:16.840100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:16.840541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:16.971065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:16.974676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:16.979955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:16.981451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:16.982591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d0d32e00-1152-46e7-8966-f08cd4f611c7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1745 microversion: 2.20 time: 0.156037 May 31 14:47:16.983169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 336/680] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:16 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:18.003606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:18.005444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:18.016435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:18.017185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:18.018921 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:18.019284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:18.191326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:18.203131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:18.206441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:18.208514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9d80fbfe-5e05-40d8-8b46-c3cfac27228f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.210099 May 31 14:47:18.210301 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 345/681] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:17 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:19.234561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:19.235267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:19.243272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:19.243731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:19.245393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:19.245835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:19.396629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:19.404680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:19.406276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:19.407636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0e1eba42-9851-4efe-afca-8c2a23a96b6c tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.179369 May 31 14:47:19.419974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 337/682] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:19 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:20.431363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:20.434496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:20.442867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:20.444495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:20.446505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:20.447316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:20.624281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:20.633278 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:20.634936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:20.636220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-afe8944d-9b81-4544-8069-e2dddc3d0a73 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.211476 May 31 14:47:20.637307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 346/683] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:20 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:21.654800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:21.655417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:21.665055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:21.666029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:21.667058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:21.667581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:21.819380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:21.829439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:21.835027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:21.840586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0882fbf4-3fe1-43f1-bb88-5c3b7be27d1b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.186304 May 31 14:47:21.851573 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 338/684] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:21 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:22.859418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:22.860050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:22.866854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:22.867299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:22.868056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:22.868488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:23.017096 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:23.026319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:23.028108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:23.029297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-961bc758-e86f-4a78-a54e-a36a1b69931b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.173837 May 31 14:47:23.034046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 347/685] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:22 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:24.049410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:24.050820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:24.058273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:24.058770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:24.059851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:24.060458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:24.226512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:24.235356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:24.237075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:24.239405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-62ae16a3-920e-4c28-9bfd-97fc833253b9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.194807 May 31 14:47:24.240476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 339/686] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:24 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:25.258690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:25.260684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:25.264811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=31 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:25.269746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:25.270208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:25.271022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:25.271802 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:25.418961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:25.425360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:25.432982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:25.434852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:25.436257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c6b101a7-95d1-4622-b33d-af33cd983178 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.181541 May 31 14:47:25.437325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 348/687] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:25 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:26.457552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:26.458202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:26.460867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=35 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:26.470697 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:26.471129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:26.472161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:26.472827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:26.629398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:26.638218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:26.639874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:26.641962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3e6c19f4-75c4-48ea-b36a-313822e978dd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.188413 May 31 14:47:26.643466 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 340/688] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:26 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:27.663868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:27.664518 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:27.673151 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:27.673858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:27.674628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:27.675084 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:27.828192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:27.836750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:27.838196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:27.839891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7f2fe1ce-6c86-49d8-aa3e-5c90a8dade52 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.180742 May 31 14:47:27.840451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 349/689] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:27 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:28.858257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:28.858907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:28.865938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:28.866503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:28.867303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:28.867751 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:29.005957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:29.014150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:29.015751 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:29.016911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-624adbdc-6894-4c2b-90dc-ab7df46261c6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.163381 May 31 14:47:29.017457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 341/690] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:28 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:47:30.039006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:30.039786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:30.046296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:30.046784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:30.047555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:30.047996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:30.183303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:30.191110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:30.192604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:30.193752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ba7710a0-74f7-4d62-9dcd-6d64cd16e88b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.158617 May 31 14:47:30.194309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 350/691] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:30 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:31.211406 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:31.212015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:31.218769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:31.219225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:31.219996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:31.220437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:31.353718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:31.362047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:31.363563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:31.364708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8516cb56-04de-4fa9-8861-6997e16e0914 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.157286 May 31 14:47:31.365270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 342/692] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:31 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:32.383577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:32.384128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:32.391080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:32.391521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:32.392267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:32.392695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:32.524866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:32.532898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:32.534394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:32.535573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7146a42b-6f72-4f80-8e85-fa63a2393e5f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.155992 May 31 14:47:32.536128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 351/693] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:32 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:33.553966 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:33.554575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:33.561343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:33.561800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:33.562563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:33.563062 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:33.908126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:33.916027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:33.918127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:33.919331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0bb06df8-7afa-4902-9c1c-89be95e1b221 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.369240 May 31 14:47:33.919889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 343/694] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:33 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:34.938580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:34.939206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:34.945799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:34.946241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:34.947032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:34.947463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:35.079997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:35.088728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:35.090223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:35.091411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dcfe90e8-6677-4fc8-89b7-303dbf52e707 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.156787 May 31 14:47:35.091967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 352/695] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:34 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:36.110032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:36.110667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:36.117261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:36.117653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:36.118417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:36.118897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:36.261333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:36.269285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:36.270788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:36.271933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e62ef406-d0de-425e-802c-3687c15970cf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.165887 May 31 14:47:36.272520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 344/696] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:36 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:37.290795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:37.291863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:37.298267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:37.298721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:37.299479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:37.299915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:37.435701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:37.443649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:37.445129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:37.446268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2529640d-25e8-4ecd-8a8a-ba8a61a78b18 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.159604 May 31 14:47:37.446847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 353/697] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:37 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:38.464484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:38.465125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:38.471743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:38.472200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:38.472963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:38.473402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:38.602049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:38.610426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:38.612009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:38.613110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a6af13df-0bcb-4f0f-8ed7-6a9ecf6002d3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.152526 May 31 14:47:38.613669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 345/698] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:38 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:39.632372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:39.632974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:39.639773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:39.640219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:39.640968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:39.641399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:39.775523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:39.783425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:39.784959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:39.786112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-50821cfd-4091-4e2c-8f13-6035a99ec71e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.157742 May 31 14:47:39.786685 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 354/699] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:39 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:40.804327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:40.805147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:40.811734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:40.812190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:40.812951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:40.813397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:40.944480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:40.955178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:40.957001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:40.958446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3848bbec-630d-4ac7-8ba2-d2035341406d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.158105 May 31 14:47:40.959169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 346/700] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:40 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:41.979231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:41.979839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:41.987066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:41.987517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:41.988286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:41.988726 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:42.122261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:42.130472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:42.132105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:42.133277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6a8c1420-5dbd-4fcd-a892-2a82415cda74 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.158007 May 31 14:47:42.133834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 355/701] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:41 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:43.151627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:43.152239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:43.158940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:43.159395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:43.160166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:43.160607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:43.288234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:43.296590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:43.298097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:43.299294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2116804d-c086-4bee-9d4c-0fe974d01e14 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.151582 May 31 14:47:43.299863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 347/702] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:43 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:44.318583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:44.319174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:44.326528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:44.327019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:44.327801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:44.328242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:44.458668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:44.466514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:44.468040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:44.469194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2a748b6d-b0c7-4690-98e0-6f6907a98435 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.154647 May 31 14:47:44.469786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 356/703] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:44 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:45.491496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:45.492098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:45.498990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:45.499443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:45.500223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:45.500652 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:45.646705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:45.655287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:45.656800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:45.657971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e6d618c2-ce15-45d5-9a76-a2b94b5666a5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.173669 May 31 14:47:45.658531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 348/704] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:45 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:46.676257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:46.676865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:46.684103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:46.684552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:46.685309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:46.685751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:46.814874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:46.822708 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:46.824265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:46.825428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b217867f-741d-4981-8de8-2b2fae71ddaf tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.153139 May 31 14:47:46.825980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 357/705] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:46 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:47.844188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:47.844826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:47.851519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:47.851997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:47.852847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:47.853283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:47.987170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:47.995002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:47.996987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:47.998136 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1820a448-9a1d-4ffe-a424-4722bb7ce3fb tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.158476 May 31 14:47:47.998705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 349/706] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:47 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:49.016185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:49.016814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:49.023316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:49.023766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:49.024542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:49.025004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:49.161607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:49.171103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:49.172662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:49.173800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-229f63f1-9564-49e9-954b-7d067e3aa67f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.161591 May 31 14:47:49.174360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 358/707] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:49 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:50.192451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:50.193082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:50.199469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:50.199914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:50.200663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:50.201097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:50.203618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=79 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:50.331141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:50.339089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:50.341264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:50.342244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-36cd9365-ba18-4125-9904-ef499781a341 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.153642 May 31 14:47:50.342820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 350/708] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:50 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:51.360727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:51.361389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:51.367828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:51.368272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:51.369015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:51.369445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:51.499509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:51.507425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:51.508918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:51.510064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d00ef245-c69c-4eb7-90f7-2eb3581dc16b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.153254 May 31 14:47:51.510629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 359/709] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:51 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:52.529561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:52.530171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:52.536726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:52.537179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:52.537959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:52.538379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:52.670176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:52.678336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:52.680151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:52.681322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-133ceabc-cb38-4213-84af-65a7553a1f0e tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.156401 May 31 14:47:52.681887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 351/710] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:52 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:53.708102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:53.708755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:53.715544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:53.715997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:53.716773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:53.717211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:53.848263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:53.856959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:53.858442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:53.859680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-da66c387-93e6-4902-b197-e04024c8923a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.155679 May 31 14:47:53.860229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 360/711] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:53 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:47:54.877612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:54.878246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:54.884812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:54.885257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:54.886015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:54.886460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:55.012625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:55.020497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:55.021990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:55.023184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1e0a4625-ecdd-4748-bbbf-a604d44fed6d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.149621 May 31 14:47:55.023870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 352/712] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:54 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:56.043686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:56.044288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:56.046575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=26 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:56.052696 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:56.053142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:56.053914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:56.054349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:56.193048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:56.201032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:56.202513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:56.203685 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6a8dd3e7-edf1-4cea-99c6-5c48cbd5bee2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.164472 May 31 14:47:56.204244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 361/713] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:56 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:57.222437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:57.223082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:57.225374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=26 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:57.231681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:57.232137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:57.232907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:57.233349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:57.363421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:57.371929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:57.373435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:57.374590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4dbe2c81-d3ca-4181-95c9-7fec6756807d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.156094 May 31 14:47:57.375184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 353/714] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:57 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:58.393103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:58.393742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:58.400149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:58.400591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:58.401343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:58.402440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:58.404967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=79 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:58.536478 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:58.552833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:58.555900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:58.558419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eef2976d-b2e4-42fa-9324-b1377fc34377 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.168453 May 31 14:47:58.559328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 362/715] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:58 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:47:59.577778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:47:59.578377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:47:59.584792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:59.585241 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:59.585992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:47:59.586427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:47:59.713209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:59.721771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:59.723319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:47:59.724494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b0264613-0dce-476e-8dc1-60e2cf617cfd tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.151215 May 31 14:47:59.725048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 354/716] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:47:59 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:00.743169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:00.743784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:00.750170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:00.750622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:00.751432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:00.751866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:00.882310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:00.890255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:00.891781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:00.892956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7319c9e8-64d6-4c39-976f-3c143e121fee tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.153923 May 31 14:48:00.893511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 363/717] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:00 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:01.911340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:01.911938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:01.919375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:01.919812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:01.920556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:01.920995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:02.055585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:02.064632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:02.066191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:02.067427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-73ea9a7c-ad01-40ca-9978-051c67bdf3ec tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.159983 May 31 14:48:02.067992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 355/718] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:01 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:03.086479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:03.087128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:03.093636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:03.094090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:03.094894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:03.095335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:03.235340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:03.243377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:03.244854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:03.246510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5f0e7a18-b2e5-4093-8062-262a5bc480d1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.163883 May 31 14:48:03.247091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 364/719] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:03 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:04.265203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:04.265836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:04.272388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:04.272756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:04.273507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:04.273944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:04.403067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:04.410974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:04.412482 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:04.413644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38dbf6fc-1bb9-4403-bc03-80a2b74b7bdc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.152907 May 31 14:48:04.414206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 356/720] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:04 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:05.432143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:05.433248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:05.440077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:05.440530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:05.441297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:05.441741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:05.735047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:05.743236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:05.744727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:05.746530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1dea8567-3759-4d70-a26f-7f8cc9b85d38 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.318595 May 31 14:48:05.747107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 365/721] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:05 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:06.765317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:06.766017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:06.772157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:06.772605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:06.773375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:06.773806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:06.913769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:06.923100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:06.924749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:06.925923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-371e170a-139b-4426-a38d-17fc40431712 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.164984 May 31 14:48:06.926482 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 357/722] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:06 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:07.945060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:07.945700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:07.952836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:07.953223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:07.953990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:07.954429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:08.093935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:08.102097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:08.103628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:08.104879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1a4157bd-fe47-4e63-83df-b9380a4eeed7 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.163679 May 31 14:48:08.105428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 366/723] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:07 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:09.123499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:09.124119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:09.131371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:09.131371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:09.132088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:09.132524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:09.263955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:09.272223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:09.273728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:09.274936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eca1ba3f-f5f9-4932-a2cc-873d260520bc tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.155460 May 31 14:48:09.275863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 358/724] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:09 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:10.294119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:10.294727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:10.300856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:10.301309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:10.302074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:10.302558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:10.441828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:10.450539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:10.452345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:10.453224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-68d34aaf-cbc5-4395-bcf7-6220a843616b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1740 microversion: 2.20 time: 0.163795 May 31 14:48:10.453771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 367/725] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:10 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:11.471779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:11.472395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:11.480089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.480544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.481323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.481768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.527624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:11.528638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:11.535875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.536366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.537163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.537600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.574856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d02262d9-4acc-44c3-ab13-05ff0ab8c477 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055277 May 31 14:48:11.575448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 368/726] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:48:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:48:11.629965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:11.637894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:11.639443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:11.640604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5405e0e2-062b-4bf6-ab83-bd0fefa1c68f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1722 microversion: 2.20 time: 0.172804 May 31 14:48:11.641169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 359/727] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:11 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:11.723128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:11.723625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:11.730145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.730602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.731385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.731824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.759772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6f6b5a37-947e-4841-a3a1-b1ca3e745f99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34" status: 200 len: 194 microversion: 2.1 time: 0.040681 May 31 14:48:11.760339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 369/728] 10.222.0.67 () {58 vars in 1412 bytes} [Tue May 31 14:48:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:48:11.770033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:11.770530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:11.778459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.779025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.779871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:11.780384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:11.862569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lazy-loading 'services' on Instance uuid 7381ef0b-479e-491d-a7c3-9f32109efb1e {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:48:11.933880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-111f61b5-af7e-4e93-a607-7e132ef80992 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34" status: 202 len: 0 microversion: 2.1 time: 0.167496 May 31 14:48:11.935120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 360/729] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 14:48:11 2022] DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/a9365341-225e-4fd1-bfda-5138abca0f34 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:48:12.659195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:12.659715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:12.666088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:12.666529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:12.667569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:12.668000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:12.799867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:12.808610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:12.810098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:12.811282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-51bcf740-f11f-4b98-8724-c73309835d87 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1722 microversion: 2.20 time: 0.156037 May 31 14:48:12.811835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 370/730] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:12 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:13.831037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:13.831726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:13.837945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:13.838470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:13.839971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:13.840476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:13.975120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:13.983621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:13.985262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:13.986416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f9d13e50-ff00-40a2-9118-22b0e50a8bf2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1725 microversion: 2.20 time: 0.160226 May 31 14:48:13.987011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 361/731] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:13 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:14.004009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d986879b-635b-43e6-890a-d234c698150e"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:48:14.005067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:14.012799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.013129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.013909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.014405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.334710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8a9d08c8-1d14-4eb7-9bea-75363bef9420 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334491 May 31 14:48:14.335391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 371/732] 10.222.0.67 () {62 vars in 1363 bytes} [Tue May 31 14:48:13 2022] POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 14:48:14.457972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:14.458870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:14.466860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.467406 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.468262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.469048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.565597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-19e5dfc2-dd7a-4eed-aba9-1b9935e19bc9 req-7a7f8d10-7c9f-4bd7-bb2c-8f021fd3272a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "name": "network-vif-unplugged", "status": "completed", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:48:14.575451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-19e5dfc2-dd7a-4eed-aba9-1b9935e19bc9 req-7a7f8d10-7c9f-4bd7-bb2c-8f021fd3272a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.575887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-19e5dfc2-dd7a-4eed-aba9-1b9935e19bc9 req-7a7f8d10-7c9f-4bd7-bb2c-8f021fd3272a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.588632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.compute.server_external_events [req-19e5dfc2-dd7a-4eed-aba9-1b9935e19bc9 req-7a7f8d10-7c9f-4bd7-bb2c-8f021fd3272a service nova] Unable to find a host for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4. Dropping event network-vif-unplugged {{(pid=124106) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 14:48:14.589684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-19e5dfc2-dd7a-4eed-aba9-1b9935e19bc9 req-7a7f8d10-7c9f-4bd7-bb2c-8f021fd3272a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028003 May 31 14:48:14.590473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 372/733] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 31 14:48:14.744272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b0d27488-7c57-484a-9d7a-99e0f8f28750 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments/d986879b-635b-43e6-890a-d234c698150e" status: 202 len: 0 microversion: 2.20 time: 0.292809 May 31 14:48:14.744875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 362/734] 10.222.0.67 () {60 vars in 1456 bytes} [Tue May 31 14:48:14 2022] DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments/d986879b-635b-43e6-890a-d234c698150e => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 14:48:14.819491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:48:14.820051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:14.826066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.826512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.827303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.827734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.919397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-45941b8a-22e3-4f01-87d4-c83537c91324 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/action" status: 202 len: 0 microversion: 2.20 time: 0.111542 May 31 14:48:14.920048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 373/735] 10.222.0.67 () {62 vars in 1318 bytes} [Tue May 31 14:48:14 2022] POST /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 14:48:14.928277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:14.928990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:14.936919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.937490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.938382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:14.938987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:14.960934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:48:15.113092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:15.125093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:15.128515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:15.130057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7661b9c6-a990-4323-b9b7-bd3d95e32dd0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1673 microversion: 2.20 time: 0.205448 May 31 14:48:15.137429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 363/736] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:14 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:16.148872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:16.149432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:16.162392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:16.162894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:16.163681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:16.164120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:16.327938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:16.336479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:16.337986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:16.339219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f560665a-b284-4b36-8828-282e39f2030b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.195076 May 31 14:48:16.339769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 374/737] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:16 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:17.366161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:17.367426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:17.375080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:17.375784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:17.376569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:17.377010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:17.697204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:17.705566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:17.707270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:17.708250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37732ddc-22df-484f-aed1-8767af36645a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.345623 May 31 14:48:17.708610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 364/738] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:17 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:18.726141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:18.726717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:18.733279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:18.733731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:18.734490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:18.734951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:18.880310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:18.882617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:48:18.891458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:18.893026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:18.894222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-168070b2-7a25-4115-b0f4-72821e1bfad5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.172081 May 31 14:48:18.894803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 375/739] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:18 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:19.912067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:19.912796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:19.922763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:19.923227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:19.924029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:19.924467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:20.074949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:20.082892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:20.084410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:20.085593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-86421f00-df3c-43cb-abad-3520f22e971a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.177445 May 31 14:48:20.086140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 365/740] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:19 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:21.106385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:21.107113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:21.114498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:21.114971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:21.115724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:21.116589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:21.313193 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:21.321104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:21.322595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:21.324264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6e202f15-a2c5-4f7f-8a12-5efd3fd07227 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.222413 May 31 14:48:21.324825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 376/741] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:21 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:22.342436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:22.343065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:22.351195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:22.351646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:22.352414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:22.352854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:22.516499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:22.524477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:22.525967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:22.527696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0c37a1dd-ecd5-45e5-bb54-bf0363d4a392 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.189312 May 31 14:48:22.528305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 366/742] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:22 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:23.547474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:23.548051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:23.554671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:23.555378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:23.556187 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:23.556634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:23.751054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:23.769970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:23.771636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:23.772942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0704b534-0961-4f64-8f3b-6ad1dd3963b3 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.229595 May 31 14:48:23.773591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 377/743] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:23 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:24.794670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:24.795375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:24.802665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:24.803235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:24.804022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:24.804519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:24.962567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:24.973341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:24.975754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:24.976305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-965fb0b4-83b0-4352-8749-80226d61c66d tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.186808 May 31 14:48:24.977043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 367/744] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:24 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:25.996199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:25.996886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:26.003760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:26.004325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:26.005102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:26.005534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:26.157746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:26.168761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:26.170252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:26.171564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d54581f2-5a01-4e71-a743-64444166f21b tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.179997 May 31 14:48:26.171996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 378/745] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:25 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:27.190910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:27.191552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:27.198097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:27.199228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:27.200002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:27.200443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:27.334108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:27.342219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:27.343771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:27.344949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-770a1f62-fdb3-4533-93c2-23bfe766dbc4 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.158150 May 31 14:48:27.345505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 368/746] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:27 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:28.364279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:28.364869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:28.367208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=38 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:48:28.373185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:28.373639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:28.374412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:28.374885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:28.508221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:28.516900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:28.518391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:28.519580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d36b7b5a-fddc-4322-9827-6eac0aa6e611 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.159281 May 31 14:48:28.520145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 379/747] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:28 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:29.537247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:29.537851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:29.540275 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=32 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:48:29.545957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:29.546404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:29.547200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:29.547639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:29.677637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:29.685942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:29.687495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:29.688679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2613c68d-5630-4f6f-a30c-fb491795cd6a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.155308 May 31 14:48:29.689238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 369/748] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:29 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:30.706917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:30.707523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:30.713959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:30.714415 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:30.715217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:30.716156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:30.844661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:30.852839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:30.854333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:30.855571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c8f62d87-75c4-4339-9e0e-13504b011d88 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.152611 May 31 14:48:30.856131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 380/749] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:30 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 14:48:31.874405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:31.875093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:31.881614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:31.882072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:31.882896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:31.883346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:32.033628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:32.041623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:32.043166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:32.044916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5aac2755-6574-4833-8cc7-939f3f41cc04 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.175008 May 31 14:48:32.045476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 370/750] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:31 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:33.063974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:33.064593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:33.071385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:33.071841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:33.072606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:33.073045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:33.221871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:33.230104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:33.232159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:33.233410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2f445379-6ebf-44dc-824b-5dee401fe3a2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.173791 May 31 14:48:33.233897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 381/751] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:33 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:34.255579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:34.256196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:34.263488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:34.263946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:34.264719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:34.265163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:34.562174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:34.569993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:34.571592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:34.572776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d5860bcf-b5d9-4f66-a148-faf96072c295 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.321114 May 31 14:48:34.573326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 371/752] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:34 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:34.672371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-bcfe42e1-e492-4c74-8e20-20482bdb89ac req-87256c1c-6ad2-433e-a8eb-d18ef05bbdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "name": "network-vif-plugged", "status": "completed", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:48:34.681148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-bcfe42e1-e492-4c74-8e20-20482bdb89ac req-87256c1c-6ad2-433e-a8eb-d18ef05bbdd5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:34.681592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-bcfe42e1-e492-4c74-8e20-20482bdb89ac req-87256c1c-6ad2-433e-a8eb-d18ef05bbdd5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:34.693064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-bcfe42e1-e492-4c74-8e20-20482bdb89ac req-87256c1c-6ad2-433e-a8eb-d18ef05bbdd5 service nova] Creating event network-vif-plugged:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:48:34.698093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-bcfe42e1-e492-4c74-8e20-20482bdb89ac req-87256c1c-6ad2-433e-a8eb-d18ef05bbdd5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029424 May 31 14:48:34.698864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 382/753] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:48:35.594111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:35.594678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:35.601099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:35.601554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:35.602324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:35.602807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:35.733292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:35.741376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:35.742938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:35.744109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9d73d260-5da4-4bd4-b4fc-e55e97dae1e1 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.154642 May 31 14:48:35.744675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 372/754] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:35 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:36.762373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:36.763107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:36.769370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:36.769819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:36.770585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:36.771049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:36.957617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:36.966489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:36.968033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:36.969331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-048d14d0-b11c-42e7-a967-95c72ddcdb48 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1731 microversion: 2.20 time: 0.211789 May 31 14:48:36.969920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 383/755] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:36 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:48:37.988313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:48:37.988909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:48:37.995712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:37.996189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:37.997035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:48:37.997477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:48:38.061597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:48:38.061849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 (ip 10.222.0.67) !!! May 31 14:48:38.133196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:38.141273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:38.142823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:48:38.144017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2ef4c297-2a30-4499-b465-5aeb8be5e1f0 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1718 microversion: 2.20 time: 0.159771 May 31 14:48:38.144562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 373/756] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:48:37 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:49:33.478633 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:33.479580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:33.482216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=9 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:33.482947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=45 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:33.489144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.489595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.490371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.490837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.520228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7195310b-a1e3-4b40-8d36-69a6d0959831 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045732 May 31 14:49:33.520788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 384/757] 10.222.0.67 () {60 vars in 1342 bytes} [Tue May 31 14:49:33 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:49:33.577768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:33.578297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:33.580320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=9 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:33.581142 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=62 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:33.587054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.587511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.588283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.588723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.614332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:49:33.688829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-643d6300-cf6d-40c4-84b7-cbb36adb2b4a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 204 len: 0 microversion: 2.20 time: 0.114625 May 31 14:49:33.689350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 374/758] 10.222.0.67 () {60 vars in 1279 bytes} [Tue May 31 14:49:33 2022] DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 14:49:33.697818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:33.698540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:33.704592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.705045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.705811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:33.706251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:33.835249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:33.843681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:33.845180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:33.846360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c4ae8528-085e-4ef1-8476-1146df16fde9 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.152623 May 31 14:49:33.846976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 385/759] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:49:33 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:49:34.865941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:34.866631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:34.873348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:34.873798 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:34.874550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:34.875008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:35.001279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:35.009238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:35.010781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:35.011951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d166460e-c7e6-4b86-8ed5-c8e5e6ff08c2 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1724 microversion: 2.20 time: 0.150290 May 31 14:49:35.012510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 375/760] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:49:34 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:49:36.039936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:36.040818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-f5b9e6e7-069d-41a5-8e99-3975b9b778c3 req-b41c3932-0d1f-4c0b-aacb-cf875e691cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78752d7e-9706-4b78-8ab7-f0e6528015b4", "name": "network-vif-deleted", "tag": "1bd61227-0575-43cb-9cb5-8915cc89a029"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:49:36.042483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:36.050538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f5b9e6e7-069d-41a5-8e99-3975b9b778c3 req-b41c3932-0d1f-4c0b-aacb-cf875e691cd5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:36.051027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-f5b9e6e7-069d-41a5-8e99-3975b9b778c3 req-b41c3932-0d1f-4c0b-aacb-cf875e691cd5 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:36.053654 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:36.054490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:36.056221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:36.056955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:36.064453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-f5b9e6e7-069d-41a5-8e99-3975b9b778c3 req-b41c3932-0d1f-4c0b-aacb-cf875e691cd5 service nova] Creating event network-vif-deleted:1bd61227-0575-43cb-9cb5-8915cc89a029 for instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 on hv-cinder-83979 May 31 14:49:36.070681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-f5b9e6e7-069d-41a5-8e99-3975b9b778c3 req-b41c3932-0d1f-4c0b-aacb-cf875e691cd5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 May 31 14:49:36.075541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 376/761] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:49:36.157931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:36.168014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:36.170253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32e6ace174a840f78c8d570719c3f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502541429884445e8426837b3fd0d75e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:49:36.172421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1ca85ca1-898b-43a6-8ddb-6ee08f66af25 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 200 len: 1366 microversion: 2.20 time: 0.139372 May 31 14:49:36.173338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 386/762] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:49:36 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 14:49:37.197537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:37.198238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:49:37.204985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:37.205441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:37.206210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:49:37.206675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:49:37.222620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 HTTP/1.1 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Openstack-Nova-Api-Version: 2.20 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:49:37.224267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:49:37.225970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '78752d7e-9706-4b78-8ab7-f0e6528015b4'} May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:49:37.226943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:49:37.228510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:49:37.229924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:49:37.229924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ce859f26-d526-4882-a639-c32411e8baa6 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 404 len: 111 microversion: 2.20 time: 0.032917 May 31 14:49:37.229924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 377/763] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:49:37 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 14:49:37.235129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0a7deeaa-2cd4-466d-b11d-66190d2fbab5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '.version_select at 0x7f8dbf681820>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:49:37.252125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0a7deeaa-2cd4-466d-b11d-66190d2fbab5 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758955175" status: 204 len: 0 microversion: 2.20 time: 0.020746 May 31 14:49:37.252692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 387/764] 10.222.0.67 () {60 vars in 1261 bytes} [Tue May 31 14:49:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758955175 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 14:50:25.439084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:50:25.439696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:51:58.070298 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:51:58.071018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:51:58.265613 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:51:58.266184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:52:22.640758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:52:22.641333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:53:45.447606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:53:45.448231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:53:46.490004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:53:46.490488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:54:11.752542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f61dd80-5dd4-4183-8dd3-bdd02f7be619] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 31 14:54:11.753361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:11.754076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:11.759698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:11.763278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:11.769480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:11.769934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:11.770725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:11.771160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:11.918198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lazy-loading 'services' on Instance uuid 7381ef0b-479e-491d-a7c3-9f32109efb1e {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 14:54:11.991171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4ea6c73e-695e-4f72-836b-e27de164b484 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/fd3df962-9600-4093-a22d-8a19d57b7ad3" status: 202 len: 0 microversion: 2.1 time: 0.240755 May 31 14:54:11.991761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 378/765] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 14:54:11 2022] DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments/fd3df962-9600-4093-a22d-8a19d57b7ad3 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 14:54:11.999481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 31 14:54:11.999990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=18 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:12.000831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:12.006521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:12.007722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:12.016582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:12.017039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:12.017815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:12.018256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:12.048486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6e0e9c1c-d30f-47c2-a381-6d6af3ca8823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051831 May 31 14:54:12.049035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 388/766] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:13.061738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:13.062671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:13.070288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:13.070764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:13.071521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:13.071958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:13.075127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f61dd80-5dd4-4183-8dd3-bdd02f7be619] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 49844. May 31 14:54:13.102635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f1f0f448-9c2c-4cbe-b467-df19cb256e63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046189 May 31 14:54:13.103198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 379/767] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:54:14.113553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:14.114482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:14.124299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:14.124755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:14.125561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:14.125999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:14.141007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 49854. May 31 14:54:14.157184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d62d962e-31e0-4299-b87b-9865c57d8171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047687 May 31 14:54:14.158394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 389/768] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:15.169600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:15.170561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:15.177639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:15.178363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:15.179162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:15.179611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:15.208440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b8985e8a-0719-4ef2-bee1-f946a1a93c4a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042931 May 31 14:54:15.208981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 380/769] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:16.219145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:16.220057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:16.226717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:16.227173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:16.227940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:16.228384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:16.258253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3dabe458-d939-4c81-adb8-dec50e563c81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043140 May 31 14:54:16.258832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 390/770] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:17.270172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:17.271061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:17.277648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:17.278106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:17.278912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:17.279357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:17.309829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5e2d5e8a-ba72-43f8-b72b-e427b5aaa12d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042678 May 31 14:54:17.310376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 381/771] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:18.321602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:18.322456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:18.328840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:18.329291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:18.330072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:18.330507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:18.359454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e300f2b3-f7f5-4b24-b924-e7d9eb72053f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041832 May 31 14:54:18.360005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 391/772] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:19.371102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:19.372020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:19.379175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:19.379632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:19.380385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:19.380822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:19.408998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9d1d6598-89ea-434d-aba2-67bfff14e3ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041950 May 31 14:54:19.409534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 382/773] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:20.420133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:20.421033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:20.427631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:20.428363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:20.429125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:20.429564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:20.459857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-971ece9a-7552-44ec-88ff-780642522733 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043731 May 31 14:54:20.460411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 392/774] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:21.471770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:21.472692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:21.479153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:21.479615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:21.480387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:21.480830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:21.509562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d2f6d34b-3f81-473a-99e1-1afdaa417c39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042420 May 31 14:54:21.510079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 383/775] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:54:22.521341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:22.522185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:22.528741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:22.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:22.529961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:22.530396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:22.560185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fc46644b-58e5-4532-81dc-4fdd5408f0ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043001 May 31 14:54:22.560725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 393/776] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:23.571689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:23.572576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:23.579229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:23.580247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:23.581017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:23.581459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:23.609822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7279f4f3-ddec-465e-a0d0-19228bf5b007 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042160 May 31 14:54:23.610355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 384/777] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:24.621408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:24.622324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:24.629350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:24.629796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:24.630552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:24.631015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:24.659124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-df6c8a9d-662c-4c9d-9a0c-71dabdb6a1fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041677 May 31 14:54:24.659665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 394/778] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:25.670712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:25.671559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:25.678196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:25.678671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:25.679446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:25.679888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:25.709179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2a43e75a-76ad-4aff-be21-cb19f19053d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042560 May 31 14:54:25.709716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 385/779] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:26.719898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:26.720781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:26.727277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:26.727733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:26.728485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:26.728924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:26.758764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fb451a04-e327-4257-b6df-1160cf0d7218 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042888 May 31 14:54:26.759315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 395/780] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:27.227729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:54:27.227910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:54:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:54:27.770959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:27.771810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:27.778223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:27.778705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:27.779472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:27.779909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:27.808548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-460ec7fe-9925-439b-a7af-7411a420390d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042321 May 31 14:54:27.809078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 386/781] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:28.820266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:28.821120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:28.827606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:28.828056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:28.828819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:28.829258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:28.858535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6b6531be-6ffc-4bbb-96bb-9d8722d4baaf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042284 May 31 14:54:28.859116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 396/782] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:29.870587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:29.871536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:29.878582 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:29.879060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:29.879826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:29.880267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:29.909918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-12cf2e97-c91d-4906-9e8f-27769dbc35bb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043297 May 31 14:54:29.910456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 387/783] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:30.921470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:30.922387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:30.929105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:30.929582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:30.930340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:30.930823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:30.961960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1c1e94e-959d-4142-8b64-983c6fe82af0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044423 May 31 14:54:30.962512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 397/784] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:31.973304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:31.974230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:31.980718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:31.981174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:31.981941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:31.982385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:32.014192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1d0a25b8-1b8e-474d-859a-278240913630 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044823 May 31 14:54:32.014779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 388/785] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:33.026095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:33.026964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:33.033566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:33.034041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:33.034904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:33.035347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:33.064959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a19331f8-7382-4120-bef3-fc1db782137b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042979 May 31 14:54:33.065511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 398/786] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:34.076329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:34.077327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:34.084984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:34.085442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:34.086228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:34.086695 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:34.116719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dd3bd93a-82a7-4830-a6d6-a4d2229508ec tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044404 May 31 14:54:34.117284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 389/787] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:35.128599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:35.129557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:35.136080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:35.136535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:35.137336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:35.137776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:35.167638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bc608862-1763-4892-9352-2ff6d868ad02 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042999 May 31 14:54:35.168212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 399/788] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:36.180271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:36.181200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:36.187638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:36.188097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:36.188870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:36.189313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:36.217550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7cf9b19e-8b51-41c3-9d12-d78610f1c888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041578 May 31 14:54:36.218091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 390/789] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:37.230002 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:37.230956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:37.237420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:37.237879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:37.238668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:37.239111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:37.267944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-50c16795-f749-43ad-bd7c-914bd15bd948 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041955 May 31 14:54:37.268480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 400/790] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:38.279473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:38.280428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:38.287388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:38.287837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:38.288592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:38.289028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:38.317913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-970a70d9-710d-4f4b-a3f8-6db08b002845 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042405 May 31 14:54:38.318443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 391/791] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:39.330273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:39.331248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:39.337636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:39.338087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:39.338949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:39.339390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:39.368579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-61230287-9947-45f9-9b97-5cc24cd93fd1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043082 May 31 14:54:39.369128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 401/792] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:40.380398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:40.381332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:40.388541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:40.388999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:40.389792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:40.390245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:40.419823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e93a40d5-65b8-4598-aa68-332ce75aa6c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043944 May 31 14:54:40.420383 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 392/793] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:41.432434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:41.433345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:41.439820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:41.440265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:41.441011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:41.441441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:41.470204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-37b92b73-9185-4bf1-a49d-139101191d70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041195 May 31 14:54:41.470776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 402/794] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:42.481498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:42.482346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:42.484641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=31 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:42.490030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:42.490490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:42.491281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:42.491748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:42.494249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:42.522760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-26354d5f-d6fe-479a-915d-1719c2303395 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045209 May 31 14:54:42.523311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 393/795] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:43.535396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:43.536342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:43.538804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=31 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:43.544097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:43.544552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:43.545299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:43.545733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:43.549950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=91 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:43.575516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-557bd6a0-13a1-401a-83b9-9980b7ed5c60 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045665 May 31 14:54:43.576063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 403/796] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:44.587365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:44.588211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:44.594286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:44.594772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:44.595542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:44.595984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:44.624546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8d973d48-10ce-48a5-8275-2b24196c860f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041397 May 31 14:54:44.625090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 394/797] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:45.636916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:45.637851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:45.644574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:45.645027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:45.645789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:45.646228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:45.675571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a9f2e960-6a78-4d8d-aa35-b04a503061d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042640 May 31 14:54:45.676121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 404/798] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:46.687642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:46.688593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:46.695428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:46.695883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:46.696670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:46.697111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:46.727136 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fffa5048-b5e6-4497-91a7-69869db9d740 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043525 May 31 14:54:46.727687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 395/799] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:47.739775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:47.740704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:47.747103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:47.747556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:47.748327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:47.748765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:47.778459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-acb6cce7-73fb-4fc7-a8af-a6d11bdc9b07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043118 May 31 14:54:47.779046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 405/800] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:48.790125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:48.791074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:48.797478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:48.798500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:48.799285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:48.799726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:48.828783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-103b4ace-d135-4534-b6de-15c86fb604ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042641 May 31 14:54:48.829340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 396/801] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:49.840737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:49.841567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:49.848003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:49.848454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:49.849213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:49.849682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:49.879396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f4b47b0-ca41-4491-a21c-e2a497736924 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042699 May 31 14:54:49.879954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 406/802] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:50.891643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:50.892597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:50.899089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:50.899538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:50.900297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:50.900732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:50.929700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3044a347-525c-4f56-815c-87e545d0ac47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042561 May 31 14:54:50.930236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 397/803] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:51.941336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:51.942290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:51.948751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:51.949204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:51.949956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:51.950389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:51.979561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c86a3e83-3ca6-4402-8b06-aeb9d3c5be99 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042217 May 31 14:54:51.980115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 407/804] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:52.991809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:52.992733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:52.999220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:52.999679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:53.000442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:53.001462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:53.031127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7ba5fa7f-97c8-4c8e-b29d-9d8a808ac66b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043228 May 31 14:54:53.031685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 398/805] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:54.042966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:54.044730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:54.051154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:54.051608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:54.052632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:54.053074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:54.086264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-08d0ee49-8354-498b-a986-34f8265c9272 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046984 May 31 14:54:54.087202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 408/806] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:55.099831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:55.100667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:55.107207 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:55.107656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:55.108419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:55.108856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:55.139971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-83f9e24f-d5f0-4020-b75b-ab7ab497c823 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044179 May 31 14:54:55.140526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 399/807] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:56.154629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:56.156117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:56.165103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:56.165558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:56.166329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:56.166799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:56.197112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dcf7865c-4965-4a06-b6cc-f2618e584dfd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049314 May 31 14:54:56.197597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 409/808] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:57.208145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:57.209058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:57.215539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:57.215986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:57.216738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:57.217172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:57.246583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-04b7850d-ca6c-4e66-9d73-e15deb2395d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042378 May 31 14:54:57.247156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 400/809] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:58.258119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:58.259057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:58.265420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:58.265861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:58.267137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:58.267567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:58.297570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1b479ed3-16ca-4883-8724-80f7c27bd112 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043407 May 31 14:54:58.298122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 410/810] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:54:59.309551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:54:59.310472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:54:59.317608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:59.318061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:59.318855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:54:59.319308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:54:59.350127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a03c3057-eeba-4dfd-a1f3-9cfc9bdc106e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044511 May 31 14:54:59.350700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 401/811] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:54:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:00.362362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:00.363307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:00.369720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:00.370174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:00.370961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:00.371395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:00.400409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b383812-32bc-4e7a-bf69-6886c267077b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042577 May 31 14:55:00.400896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 411/812] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:01.412920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:01.413864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:01.423100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:01.423560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:01.424361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:01.425115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:01.458831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-352e3b1a-51c5-4190-9cb5-773ecb8be339 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049858 May 31 14:55:01.459409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 402/813] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:02.470837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:02.471777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:02.478610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:02.479102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:02.479879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:02.480322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:02.512518 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0a5bef90-cc10-44e9-9d3e-1fb56a4cffc3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045668 May 31 14:55:02.513107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 412/814] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:03.524308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:03.525362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:03.533710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:03.534162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:03.535050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:03.535490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:03.567248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-573985c1-b41b-4db1-bd2c-fbf285e0681f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046831 May 31 14:55:03.567829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 403/815] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:04.578755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:04.579606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:04.586347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:04.586908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:04.587681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:04.588126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:04.619125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d58d8dd2-98de-4569-8f0a-33083180ee94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044428 May 31 14:55:04.619688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 413/816] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:05.630861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:05.631808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:05.638309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:05.638799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:05.639558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:05.639992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:05.669936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8da7a5c6-d7e0-4440-a30b-08569c4325bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043016 May 31 14:55:05.670490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 404/817] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:06.682105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:06.683066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:06.689541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:06.689995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:06.690800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:06.691242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:06.722153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d8013867-c5b5-4d08-b84f-efd02c9a6581 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044521 May 31 14:55:06.722755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 414/818] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:07.733900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:07.734870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:07.741334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:07.741778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:07.742538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:07.742997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:07.773904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-60d6c654-3729-4fa1-862a-3df88a1f7e54 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043952 May 31 14:55:07.774448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 405/819] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:08.786296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:08.787224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:08.793950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:08.794410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:08.795232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:08.795667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:08.826857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c84a93b3-66a4-4368-abff-4bc45689dac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045165 May 31 14:55:08.827429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 415/820] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:09.839448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:09.840279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:09.847262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:09.847711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:09.848474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:09.848917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:09.879228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7da3d7ee-e006-4428-bbf3-73caa45e34aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043838 May 31 14:55:09.879789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 406/821] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:10.891000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:10.892483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:10.899092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:10.899544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:10.900318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:10.900751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:10.931211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-650c4d20-83fe-4c88-9fcd-c177b176b43d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044165 May 31 14:55:10.931810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 416/822] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:11.943153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:11.944115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:11.950680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:11.951147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:11.951922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:11.952366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:11.983308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-85505de5-ecb0-41e2-bec5-06b37f429552 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044115 May 31 14:55:11.983905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 407/823] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:12.995099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:12.996057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:13.002531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:13.003006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:13.003765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:13.004202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:13.034593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-59f00253-c92c-4617-9a09-46b217aece52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043480 May 31 14:55:13.035186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 417/824] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:55:14.046350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:14.047301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:14.049313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:14.055028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:14.055514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:14.056296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:14.056746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:14.060587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:14.087888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-975b92e8-1b93-4bc0-aed9-15b997a1cba7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045506 May 31 14:55:14.088464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 408/825] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:15.100484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:15.101688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:15.103676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:15.109073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:15.109525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:15.110972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:15.111421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:15.113981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:15.142777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d99f55e2-c26a-4a98-8a6a-b2148acfe62f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046478 May 31 14:55:15.143347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 418/826] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:16.154306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:16.155276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:16.162059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:16.162449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:16.163461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:16.163908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:16.201398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b95de349-ee62-4fe4-8c2f-4adce070f25e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051074 May 31 14:55:16.201965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 409/827] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:17.213435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:17.214359 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:17.222335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:17.222808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:17.223573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:17.224006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:17.255628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3fb2d69-4df0-42c3-9f07-71b9b5669596 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046113 May 31 14:55:17.256208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 419/828] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:18.078532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:55:18.079208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:55:18.268067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:18.268923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:18.273855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:55:18.274347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:55:18.275743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:18.276280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:18.277120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:18.277412 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:18.309086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-552ef631-520a-4117-885e-640746959025 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045624 May 31 14:55:18.309644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 410/829] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:19.320966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:19.321894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:19.328991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:19.329383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:19.330246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:19.330795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:19.365167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d63f57d1-6c35-41e3-aa82-4031cab77029 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048139 May 31 14:55:19.365743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 420/830] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:20.377612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:20.378445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:20.385011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:20.385458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:20.386273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:20.386736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:20.417420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5ad60d4c-017b-488f-a41f-9cd5add968c7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044363 May 31 14:55:20.417989 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 411/831] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:21.429905 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:21.430768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:21.437209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:21.437656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:21.438445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:21.438904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:21.467512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b8201c36-23ea-4d16-8751-a7d368e6b0c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041902 May 31 14:55:21.468063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 421/832] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:22.479622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:22.480452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:22.487003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:22.487455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:22.488215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:22.488655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:22.518488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ba3fbabf-f175-416e-8c4c-e88b995877fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042845 May 31 14:55:22.519117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 412/833] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:23.530349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:23.531257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:23.538229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:23.538723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:23.539500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:23.539946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:23.570420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eadffc03-9f93-4bf1-862c-5585a5272ed3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044059 May 31 14:55:23.571017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 422/834] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:24.581954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:24.582827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:24.589264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:24.589720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:24.590488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:24.590962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:24.620149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ae10f8e7-ca7b-4b8a-8c7e-2615d3834a40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042238 May 31 14:55:24.620694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 413/835] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:25.632362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:25.633199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:25.639749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:25.640200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:25.640960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:25.642028 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:25.670537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cbe0d935-25cf-442d-845a-6dd7c89cf133 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042179 May 31 14:55:25.671124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 423/836] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:26.682621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:26.683503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:26.690031 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:26.690485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:26.691286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:26.691734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:26.721290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-468373af-299f-40b9-97ad-874eb24c785d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042753 May 31 14:55:26.721840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 414/837] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:27.732981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:27.733856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:27.740996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:27.741450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:27.742207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:27.742657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:27.771284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cdf3cd78-8f11-4875-8bf4-195c3c4f0c5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042068 May 31 14:55:27.771896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 424/838] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:28.783191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:28.784058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:28.790533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:28.791022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:28.791803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:28.792246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:28.821769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3ec6b68-0ed3-44a3-bf1e-3c2622c310f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042700 May 31 14:55:28.822320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 415/839] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:29.833980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:29.834885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:29.841409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:29.841855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:29.842608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:29.843066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:29.872845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4b5a535d-c297-4bd5-80fa-c9e869549cfb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042881 May 31 14:55:29.873406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 425/840] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:30.884625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:30.885467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:30.892557 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:30.893008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:30.893769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:30.894209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:30.922784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6fedd0d0-08e8-42d2-85fc-2dfed2ddc4cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042206 May 31 14:55:30.923372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 416/841] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:31.934602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:31.935483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:31.942085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:31.942456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:31.943255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:31.943697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:31.973763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b4c9ad1-a7dd-4e76-bf86-a17dad7e5056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043244 May 31 14:55:31.974312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 426/842] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:32.986227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:32.987088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:32.993511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:32.993957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:32.994738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:32.995171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:33.023317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f85884b8-4375-475e-9960-b48973365eb5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041719 May 31 14:55:33.023864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 417/843] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:34.035031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:34.035871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:34.042289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:34.042777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:34.043531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:34.043966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:34.073214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e7682790-7d6b-4a85-a9c8-71b90ac44bc0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042259 May 31 14:55:34.073767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 427/844] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:55:35.085368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:35.086240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:35.092738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:35.093227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:35.093990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:35.095083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:35.124271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0179156d-8478-4e01-9699-358cdaff079b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042930 May 31 14:55:35.124831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 418/845] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:36.135995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:36.136923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:36.144280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:36.144735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:36.145496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:36.145936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:36.174818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d332eab0-e994-441a-b8e5-c8e838322a1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042771 May 31 14:55:36.175365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 428/846] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:37.187019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:37.187914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:37.195019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.195501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.196277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.196720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.226279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7138bd04-473c-4ca9-8035-e98b991d029b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043630 May 31 14:55:37.226870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 419/847] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:37.692364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:37.692907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:37.699267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.699710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.700473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.700902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.714862 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 HTTP/1.1 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Openstack-Nova-Api-Version: 2.20 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 14:55:37.716510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.718297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '78752d7e-9706-4b78-8ab7-f0e6528015b4'} May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:55:37.719282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.720887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 14:55:37.722456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:55:37.722456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-687c4252-df20-4d54-96fd-c6477dc3a00a tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 404 len: 111 microversion: 2.20 time: 0.029857 May 31 14:55:37.722456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 429/848] 10.222.0.67 () {60 vars in 1279 bytes} [Tue May 31 14:55:37 2022] DELETE /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 14:55:37.726520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:37.727183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: 78752d7e-9706-4b78-8ab7-f0e6528015b4] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:37.733193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.733649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.734421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:37.734917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:37.748171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 HTTP/1.1 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Openstack-Nova-Api-Version: 2.20 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 14:55:37.749812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.752009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '78752d7e-9706-4b78-8ab7-f0e6528015b4'} May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 14:55:37.752950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. May 31 14:55:37.754441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 14:55:37.755829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance 78752d7e-9706-4b78-8ab7-f0e6528015b4 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 14:55:37.755829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3e541d84-3c00-408c-bbab-cb96fe11d608 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4" status: 404 len: 111 microversion: 2.20 time: 0.029115 May 31 14:55:37.755829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 420/849] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 14:55:37 2022] GET /compute/v2.1/servers/78752d7e-9706-4b78-8ab7-f0e6528015b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 14:55:38.238810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:38.239647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:38.245677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:38.246128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:38.246923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:38.247459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:38.276249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-daa8f02d-546a-46cc-8553-23bad90918f3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042170 May 31 14:55:38.276803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 430/850] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:39.288371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:39.289465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:39.297026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:39.297486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:39.298261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:39.298721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:39.330327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-78c21852-34ed-42a3-bc06-ce4c34932047 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045458 May 31 14:55:39.330677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 421/851] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:55:40.341790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:40.342624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:40.349669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:40.350118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:40.350917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:40.351358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:40.380005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3879730-842a-4afe-83d5-dc0dd8547f3d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042284 May 31 14:55:40.380551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 431/852] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:41.391642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:41.392566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:41.399007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:41.399461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:41.400221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:41.400661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:41.431022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37e1fa07-54eb-442f-8df3-8225015fb495 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043299 May 31 14:55:41.431569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 422/853] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:42.443896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:42.444875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:42.452378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:42.452824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:42.453621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:42.454053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:42.483898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-22763e2d-e68c-44ef-bd36-6636d386e190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044000 May 31 14:55:42.484463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 432/854] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:43.496648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:43.497586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:43.504478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:43.504976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:43.505726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:43.506168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:43.536123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-005f2100-ee74-42cb-8eb7-5f7fb661766f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043434 May 31 14:55:43.536697 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 423/855] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:44.548754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:44.549578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:44.555929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:44.556374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:44.557127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:44.557553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:44.586813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3ee648ef-2a41-4ac9-9f09-3f439d8f9435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042802 May 31 14:55:44.587366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 433/856] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:45.598955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:45.599787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:45.602074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=32 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:45.607414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:45.607862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:45.608627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:45.609058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:45.613234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=92 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:45.639291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8729bce7-1d9e-4ecf-8b3e-ac01e95f9908 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044451 May 31 14:55:45.639831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 424/857] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:46.650235 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:46.651187 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:46.653599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=32 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:46.658870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:46.659319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:46.660089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:46.660525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:46.664318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=92 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:46.690073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8211aa7e-35e8-4b2f-8ab5-da3793e721a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043780 May 31 14:55:46.690625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 434/858] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:47.701487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:47.702405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:47.709111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:47.709570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:47.710340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:47.710882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:47.752439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bd6c0148-0e42-4a81-bb4e-34747deb68a0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054857 May 31 14:55:47.753023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 425/859] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:48.765488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:48.767042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:48.773605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:48.774052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:48.774846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:48.775287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:48.805015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-261fc64e-fd19-43fa-8aad-1afd21a918f8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043561 May 31 14:55:48.805578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 435/860] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:55:49.817208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:49.818052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:49.824636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:49.825099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:49.825870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:49.826316 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:49.855867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-06257229-5f60-4687-a5a7-41c367b08001 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043180 May 31 14:55:49.856424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 426/861] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:50.868196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:50.869122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:50.875673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:50.876130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:50.876895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:50.877335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:50.907642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a659ec98-7261-4fae-94bc-21b943794e52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043432 May 31 14:55:50.908197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 436/862] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:55:51.919190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:51.920120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:51.927670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:51.928130 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:51.928905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:51.929351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:51.958919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e83ff912-194b-4ccd-816d-04ef7f26a2ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043587 May 31 14:55:51.959491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 427/863] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:52.970631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:52.971585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:52.977998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:52.978452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:52.979283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:52.979722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:53.012280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0df4770f-5e79-425c-aad7-6b10aceea497 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045576 May 31 14:55:53.012846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 437/864] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:54.023913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:54.024844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:54.031307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:54.031769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:54.032571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:54.033018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:54.061916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-16809e6d-e9fa-4770-9dc1-87f19cfbf611 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041960 May 31 14:55:54.062983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 428/865] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:55.073535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:55.074455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:55.081475 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:55.081871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:55.082629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:55.083168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:55.112482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ab5a75d8-34c8-45aa-a7d8-7dab9734f2f2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042966 May 31 14:55:55.113033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 438/866] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:56.124971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:56.126439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:56.133533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:56.134011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:56.134810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:56.135245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:56.166590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c9dae809-86a3-4f21-b901-e9a2ea2d2847 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046236 May 31 14:55:56.167186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 429/867] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:57.178210 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:57.179157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:57.185723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:57.186200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:57.186986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:57.187783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:57.217515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-54432add-737c-4502-b267-9be761ac1544 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043442 May 31 14:55:57.218070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 439/868] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:58.229350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:58.230381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:58.237532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:58.237997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:58.238798 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:58.239248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:58.268639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5ac8fc70-4e7a-455b-b05f-2d9cb9700ab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043231 May 31 14:55:58.269192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 430/869] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:55:59.280136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:55:59.281061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:55:59.288177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:59.288797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:59.289571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:55:59.290012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:55:59.320100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-93be4957-609f-44a4-bc04-b7972779011d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043907 May 31 14:55:59.320650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 440/870] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:55:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:00.332288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:00.333217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:00.339758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:00.340219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:00.340987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:00.341435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:00.370926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9c3f30d2-7e0f-4c36-839b-cdcdcf0c0312 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043134 May 31 14:56:00.371692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 431/871] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:01.382111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:01.382975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:01.389438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:01.389889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:01.390663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:01.391106 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:01.420010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-980b135b-a268-4826-a2c5-94216d08dd33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041981 May 31 14:56:01.420570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 441/872] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:02.432572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:02.433622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:02.440707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:02.441172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:02.441962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:02.442389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:02.475007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c8c94e98-112a-4f5a-8d04-f9475c0982b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045958 May 31 14:56:02.476007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 432/873] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:03.488224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:03.489185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:03.495973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:03.496425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:03.497203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:03.497636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:03.527949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0bed3560-744f-40ed-8276-a07467093482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044257 May 31 14:56:03.528513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 442/874] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:04.542204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:04.542991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:04.550378 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:04.550857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:04.551874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:04.552670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:04.583757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24efc5be-7618-47a4-925a-2b5716f10da8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047906 May 31 14:56:04.584308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 433/875] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:05.596265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:05.597201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:05.603743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:05.604198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:05.604967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:05.605409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:05.634941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9be9ee97-2688-425f-94bc-ed6ed8d78237 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043127 May 31 14:56:05.635443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 443/876] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:06.647713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:06.648630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:06.655053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:06.655506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:06.656825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:06.657258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:06.685797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7cbac086-88da-4fb9-970e-1e519e28fada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042038 May 31 14:56:06.686341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 434/877] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:07.697299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:07.698218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:07.704757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:07.705206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:07.705963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:07.706399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:07.736947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0070b4a8-aa5d-46cd-9e0c-bbd4e988eed4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043554 May 31 14:56:07.737511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 444/878] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:08.748653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:08.749488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:08.756024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:08.756474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:08.757228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:08.757660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:08.787147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c6334320-8bf1-4a70-9e27-14a281cf891a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042551 May 31 14:56:08.787698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 435/879] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:09.799509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:09.800352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:09.807227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:09.807682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:09.808445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:09.808892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:09.838211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-78e79e6b-5a46-4cd4-b005-bb914862e406 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043374 May 31 14:56:09.838787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 445/880] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:10.849798 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:10.850665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:10.857296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:10.857753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:10.858534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:10.859084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:10.891467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b47a5fdb-6408-4293-8501-6a7a1cc5c31c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045679 May 31 14:56:10.892041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 436/881] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:11.903480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:11.904412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:11.911714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:11.912166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:11.912950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:11.913393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:11.943519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-012c6c61-1a25-405c-b827-1090834bf4a6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043983 May 31 14:56:11.944079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 446/882] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:12.955377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:12.956216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:12.963389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:12.963389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:12.964039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:12.964475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:13.009779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d244c92d-c236-4e2e-8168-a7b396e9ac3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058320 May 31 14:56:13.010355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 437/883] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:14.021722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:14.022669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:14.029224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:14.029680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:14.030454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:14.030916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:14.061443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-42b1e4a8-a55f-4008-a57d-ef69d29786a9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043710 May 31 14:56:14.062653 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 447/884] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:15.073802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:15.074635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:15.081317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:15.081762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:15.082534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:15.083019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:15.113573 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cc8eacf5-fe9f-4ca0-b1df-e03bd42ad3c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044022 May 31 14:56:15.114149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 438/885] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:16.126102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:16.127062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:16.133317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:16.133774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:16.134549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:16.135017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:16.164404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f344226d-944b-493d-b69d-06a87203e90e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043019 May 31 14:56:16.164956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 448/886] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:17.176171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:17.177416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:17.180050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:17.185800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:17.186242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:17.187034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:17.187470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:17.189937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:17.220085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1fbb0d7c-cf71-45ad-b51e-7fc97d2f67ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047868 May 31 14:56:17.220660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 439/887] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:18.231931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:18.232861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:18.235322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:18.240849 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:18.241298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:18.242070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:18.242512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:18.245173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:18.278220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-32bd5444-8678-4143-9d85-98649d06f416 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050293 May 31 14:56:18.278814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 449/888] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:19.290234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:19.291840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:19.299844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:19.300309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:19.301206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:19.301990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:19.339197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cfb6fcb8-ebca-45f5-b546-87a6f4e528b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053060 May 31 14:56:19.339797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 440/889] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:20.351660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:20.353163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:20.359762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:20.360208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:20.360958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:20.361561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:20.393929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a9261d53-ce35-46f2-9b72-245412fd762a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046039 May 31 14:56:20.394511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 450/890] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:21.406677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:21.407624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:21.414094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:21.414550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:21.415487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:21.415930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:21.445178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3bf77731-3284-4918-8f03-38ae84688d4e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043061 May 31 14:56:21.445725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 441/891] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:22.457493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:22.458410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:22.465110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:22.465562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:22.466326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:22.466792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:22.495890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cde771c8-ff6f-4171-ba86-77f3da2f096f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042879 May 31 14:56:22.496454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 451/892] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:23.508364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:23.509197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:23.515802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:23.516257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:23.517041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:23.517471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:23.548595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b20abbea-d91d-424b-a7a1-3ac207b8daee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044287 May 31 14:56:23.549173 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 442/893] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:24.560609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:24.561567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:24.568066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:24.568516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:24.569273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:24.569710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:24.599455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c174e46f-047a-42fb-82dd-a53346d70d50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042798 May 31 14:56:24.600019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 452/894] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:25.611610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:25.612664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:25.619176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:25.619637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:25.620409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:25.620855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:25.650073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-90ff3585-fbe9-473d-b374-40286a006fae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043082 May 31 14:56:25.650663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 443/895] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:26.661290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:26.662416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:26.670768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:26.671990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:26.672782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:26.673513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:26.705869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c97da325-e9b1-4fb0-8fb3-ae15625a6b65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048494 May 31 14:56:26.706434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 453/896] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:27.718983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:27.719944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:27.726455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:27.726942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:27.727746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:27.728192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:27.757827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b7b95326-146d-45de-bfab-104cb4173888 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042831 May 31 14:56:27.758382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 444/897] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:28.769614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:28.770458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:28.777097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:28.777553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:28.778315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:28.778866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:28.808094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5901ff91-b376-4679-98a2-b5e12cd411b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043032 May 31 14:56:28.808648 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 454/898] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:29.819114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:29.819953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:29.826632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:29.827120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:29.828382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:29.828830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:29.859015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-64fc2415-cb4e-47dd-a16e-5fa2720b3f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043966 May 31 14:56:29.859584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 445/899] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:30.870945 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:30.871870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:30.878337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:30.878825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:30.879583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:30.880022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:30.908911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-89669bfc-7717-4229-9718-dec79fd24797 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042017 May 31 14:56:30.909456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 455/900] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:31.919554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:31.920473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:31.927143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:31.927592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:31.928345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:31.928781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:31.957433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c84c11d4-8503-44c5-8271-bb9d0f312491 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041819 May 31 14:56:31.957979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 446/901] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:32.969776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:32.970728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:32.977234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:32.977689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:32.978459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:32.978929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:33.009421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1fcc471c-28ad-4762-b926-0b87237157b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044071 May 31 14:56:33.009998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 456/902] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:34.021747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:34.022704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:34.029563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:34.030022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:34.030891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:34.031372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:34.063093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dfd68641-2cfe-4f4b-8062-95dd979aa859 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045229 May 31 14:56:34.063662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 447/903] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:35.078272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:35.079514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:35.088650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:35.089100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:35.089863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:35.090299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:35.120811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-512f3c7d-989c-4416-81d0-2794c73f58e6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049009 May 31 14:56:35.121372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 457/904] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:36.132312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:36.133242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:36.139731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:36.140193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:36.140973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:36.141413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:36.170778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-45ec0b63-760e-436b-ae7b-9ac46b8c05d1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042392 May 31 14:56:36.171892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 448/905] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:37.183153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:37.184095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:37.191170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:37.191620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:37.192378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:37.192811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:37.221118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-52dd97e8-0767-401d-b3bf-f2567c185f07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041914 May 31 14:56:37.221694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 458/906] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:38.232937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:38.235240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:38.241805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:38.242252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:38.243077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:38.243514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:38.273036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-62ecc9a1-227b-414c-a51a-e426fbd029b7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044200 May 31 14:56:38.273574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 449/907] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:56:39.284786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:39.285745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:39.292348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:39.293000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:39.293554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:39.293992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:39.324133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-369f76e9-0f12-4d46-a52f-198900a06a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043363 May 31 14:56:39.324694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 459/908] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:40.336505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:40.337419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:40.344578 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:40.345027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:40.345780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:40.346214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:40.374585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2c8758c8-e7c6-4caf-9d68-371789115ded tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042039 May 31 14:56:40.375158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 450/909] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:41.386239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:41.387261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:41.394323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:41.394809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:41.395572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:41.396012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:41.425152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e2157ab9-d713-4380-a39d-6346954e6382 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042953 May 31 14:56:41.425704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 460/910] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:42.436912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:42.437865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:42.445121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:42.445635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:42.446327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:42.446787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:42.475792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8808aff2-59af-45a4-9e8e-25b1053bd523 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042885 May 31 14:56:42.476328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 451/911] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:43.487486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:43.488406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:43.494879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:43.495335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:43.496097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:43.496535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:43.526134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2e604dc9-777f-4218-a9b0-f5d3d2d80f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042672 May 31 14:56:43.526699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 461/912] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:44.537576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:44.538391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:44.544536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:44.544988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:44.545739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:44.546179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:44.578660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e272d7e0-12fd-4e0c-bb84-5f7ba2e3538a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045167 May 31 14:56:44.579256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 452/913] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:45.590790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:45.591727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:45.597734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:45.598221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:45.599012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:45.599454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:45.629469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c11313f7-d601-4e2e-a09e-961313514f0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043145 May 31 14:56:45.630030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 462/914] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:46.641865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:46.642847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:46.649363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:46.649820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:46.650586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:46.651093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:46.680447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-350a3988-7fa4-4322-9460-9a2923952591 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043187 May 31 14:56:46.681009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 453/915] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:47.692334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:47.693263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:47.699783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:47.700246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:47.701012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:47.701454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:47.731869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a51b030a-7fe1-4039-9bff-937bd37a1e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043628 May 31 14:56:47.732432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 463/916] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:48.743297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:48.744229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:48.746559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:48.751856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:48.752317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:48.753094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:48.753539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:48.757354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:48.783582 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8e7698e4-9822-4e36-8952-684fa4553187 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044266 May 31 14:56:48.784134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 454/917] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:49.795892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:49.796877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:49.799885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:49.805503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:49.805959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:49.806753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:49.807196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:49.810931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:49.836809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ce1e95e4-f21b-42eb-94ad-e5c2a1dcfe1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044847 May 31 14:56:49.837369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 464/918] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:50.849004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:50.849870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:50.856499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:50.856948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:50.857710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:50.858141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:50.887221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f51f5ce0-996f-4edd-9763-1233d533abc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043080 May 31 14:56:50.887767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 455/919] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:51.898537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:51.899499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:51.905979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:51.906431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:51.907221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:51.907661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:51.936583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bb758ad3-ff96-4959-be0a-45a350b21053 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042091 May 31 14:56:51.937138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 465/920] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:52.948903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:52.949955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:52.957211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:52.957664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:52.958442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:52.958927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:52.988111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-22449901-019a-4f85-a993-fca99ee006dd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043171 May 31 14:56:52.988658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 456/921] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:53.999879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:54.000808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:54.007375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:54.007830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:54.008601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:54.009040 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:54.038206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0ac1db6c-913b-4759-9c20-a9af3c1e4d81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042301 May 31 14:56:54.038795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 466/922] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:55.050421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:55.051533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:55.058093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:55.058540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:55.059335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:55.059773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:55.089701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2ccc2235-ca0d-41f6-99c9-7bd2982cee9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043813 May 31 14:56:55.090266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 457/923] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:56:56.101876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:56.102820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:56.109217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:56.109661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:56.110445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:56.110897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:56.140184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f96bbf1-8391-4719-87c9-ab37536c5f79 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042586 May 31 14:56:56.140737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 467/924] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:57.152404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:57.153352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:57.160481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:57.160929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:57.161684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:57.162125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:57.192056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f8351b8e-9b28-4ef1-a9f8-8821bba53763 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043735 May 31 14:56:57.192615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 458/925] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:58.204279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:58.205200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:58.211663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:58.212121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:58.212884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:58.213323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:58.244723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0e0d0b20-25f2-4345-887e-464f047e213e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044914 May 31 14:56:58.245297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 468/926] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:56:59.256891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:56:59.257812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:56:59.264319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:59.264768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:59.265527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:56:59.266590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:56:59.296292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c02455f0-2433-4123-8511-72c6ac37c7ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043302 May 31 14:56:59.296869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 459/927] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:56:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:00.308039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:00.308971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:00.316097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:00.316538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:00.317285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:00.317716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:00.350489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d6f81c9e-53ef-4cac-87db-04269ab7d958 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046342 May 31 14:57:00.351072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 469/928] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:01.362029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:01.362985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:01.369559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:01.370016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:01.370807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:01.371259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:01.400583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0f789671-59f8-4277-bb71-05c66e80a5d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042626 May 31 14:57:01.401141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 460/929] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:02.412646 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:02.413574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:02.420125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:02.420583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:02.421362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:02.421801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:02.452782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-296d41e5-6c8f-46fc-a452-d2338662ad2a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044045 May 31 14:57:02.453351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 470/930] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:03.464945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:03.465866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:03.472679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:03.473138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:03.473926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:03.474372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:03.506870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-94ad170c-ea25-4454-8a1b-28a557134bdb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045875 May 31 14:57:03.507459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 461/931] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:04.518101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:04.519064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:04.528382 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:04.528840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:04.529628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:04.530070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:04.562039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6da057c5-7e83-4266-8f12-a02a8773b79d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047881 May 31 14:57:04.562604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 471/932] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:05.457443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:57:05.457900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:57:05.575244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:05.576903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:05.586794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:05.587476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:05.588651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:05.589314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:05.629312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a43a25b9-ac77-4ac6-9e69-401883cc06aa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058348 May 31 14:57:05.629904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 462/933] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:06.498915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:57:06.499602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:57:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:57:06.641487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:06.642409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:06.648940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:06.649384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:06.650142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:06.651177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:06.680367 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-944f5efc-51ea-46ab-9c61-80b4c0fd3b52 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043305 May 31 14:57:06.680920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 472/934] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:07.692119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:07.693038 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:07.699560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:07.700008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:07.700766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:07.701206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:07.729960 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-169d651c-0ed7-44e1-881e-7f18fdfee40a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041928 May 31 14:57:07.730506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 463/935] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:08.741969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:08.742921 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:08.749366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:08.749822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:08.751223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:08.751663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:08.780522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bc17baf1-314f-4269-bc22-9ca1963b44ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042554 May 31 14:57:08.781074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 473/936] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:09.792310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:09.793246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:09.800379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:09.801097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:09.801869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:09.802319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:09.831410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-26b8a20a-a255-4fb9-8219-9cf7cca6344c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043093 May 31 14:57:09.831976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 464/937] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:10.843516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:10.844360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:10.851224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:10.851675 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:10.852441 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:10.852881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:10.884319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f2fcd400-1ef2-4a66-b42a-a5b9fce7ef6f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044834 May 31 14:57:10.884880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 474/938] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:11.899043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:11.900327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:11.908039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:11.908490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:11.909267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:11.909735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:11.941903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c619d822-da8e-4b99-852c-d62ef8e102cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048372 May 31 14:57:11.942471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 465/939] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:12.954321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:12.955305 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:12.962143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:12.962594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:12.963398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:12.963836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:12.995809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6be099c7-84cb-47fb-bf73-c87f33cb7807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045536 May 31 14:57:12.996388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 475/940] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:14.007472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:14.008401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:14.015196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:14.015651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:14.016430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:14.016875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:14.048069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f87732ed-0d2e-42bc-ac89-811bfcda896e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044586 May 31 14:57:14.048641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 466/941] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:15.060629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:15.061557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:15.068057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:15.068503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:15.069287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:15.069799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:15.101795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-47e0f2bf-60dc-45d1-9418-54915deea822 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045020 May 31 14:57:15.102391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 476/942] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:16.114418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:16.115423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:16.122586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:16.123090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:16.123900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:16.124338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:16.158494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fd74ba9b-3e65-4e02-b5c9-437a5f5f2784 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048082 May 31 14:57:16.159143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 467/943] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:17.170556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:17.171532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:17.178985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:17.179446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:17.180273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:17.180717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:17.215130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1bbf798-2699-440f-8ec9-06b5c5cdf9b8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048459 May 31 14:57:17.215724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 477/944] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:18.229244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:18.230409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:18.237975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:18.238430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:18.239239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:18.239679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:18.272919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3898d379-85a5-45ff-9961-26b63ee854d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047876 May 31 14:57:18.273509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 468/945] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:19.284467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:19.285517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:19.292230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:19.292752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:19.293838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:19.294367 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:19.335116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b8f88649-50c8-43bf-8fe8-ba0447ad0385 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054768 May 31 14:57:19.335878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 478/946] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:20.350640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:20.351919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:20.354509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:20.361472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:20.361926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:20.362846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:20.363288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:20.366011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:20.398587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2b370dd1-4c92-4982-b2e6-d0e805cde452 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052401 May 31 14:57:20.399571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 469/947] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:21.414775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:21.416264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:21.420160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:21.430014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:21.430800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:21.432091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:21.432809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:21.440208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:21.482731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-25922984-0903-4b13-bbcd-cc1fc01cd69b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.074949 May 31 14:57:21.483594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 479/948] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:22.496144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:22.497068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:22.503982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:22.504436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:22.505219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:22.505713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:22.538208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-327556fb-2748-42d5-a050-4056b344e889 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046174 May 31 14:57:22.538839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 470/949] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:22.651123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:57:22.651448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:57:23.553440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:23.554378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:23.561391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:23.561870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:23.563266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:23.563706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:23.595796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6000c727-2ead-40bb-a8f4-0ab4c01460a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046648 May 31 14:57:23.596374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 480/950] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:24.608003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:24.609423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:24.616786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:24.617295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:24.618123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:24.618605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:24.652094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a75d0eba-0a67-41bd-85dc-210d63d50463 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048267 May 31 14:57:24.652666 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 471/951] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:25.666596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:25.667560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:25.674926 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:25.675373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:25.676412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:25.676847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:25.708973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4423ecd6-f358-4349-a1f9-b64b5e9233dc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046449 May 31 14:57:25.709542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 481/952] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:26.721736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:26.722700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:26.729725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:26.730184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:26.731098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:26.731540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:26.763847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fba0c5b6-e423-4058-948c-b9cb67abdd39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046673 May 31 14:57:26.764431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 472/953] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:27.776629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:27.777565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:27.784316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:27.784754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:27.785541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:27.785982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:27.818982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9c0dfa90-4b23-44ba-a529-0ca945860f1e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046448 May 31 14:57:27.819559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 482/954] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:28.832718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:28.833639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:28.840723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:28.841217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:28.842046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:28.842522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:28.876574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a7b114b1-1f87-4020-9a93-cd2710824d3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048526 May 31 14:57:28.877195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 473/955] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:29.888884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:29.889879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:29.896574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:29.897031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:29.897814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:29.898255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:29.930064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eb36ad5c-7384-4509-88ff-f2d15c50d892 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045104 May 31 14:57:29.930638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 483/956] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:30.942435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:30.943382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:30.950009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:30.950460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:30.951256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:30.951689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:30.981764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d6e3426b-6dbc-445d-a359-f7ed4f709ef0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043247 May 31 14:57:30.982321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 474/957] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:31.993601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:31.994532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:32.003585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:32.004120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:32.004969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:32.005474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:32.036287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ac2a5f0f-1241-42aa-904e-ccd15873ca67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046657 May 31 14:57:32.036859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 484/958] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:33.048795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:33.049637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:33.056924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:33.057393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:33.058157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:33.058597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:33.088325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-81a4434a-5b72-442f-a126-7ec56302827a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044203 May 31 14:57:33.088878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 475/959] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:34.100993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:34.102163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:34.109756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:34.110210 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:34.111026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:34.111472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:34.144916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7b98058a-f656-46a6-98c5-2ccf8c48c74c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048069 May 31 14:57:34.145490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 485/960] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:35.156413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:35.157364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:35.163802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:35.164248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:35.165005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:35.165440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:35.195141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-86e6856d-7074-4776-9453-f61c9117db43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043112 May 31 14:57:35.195698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 476/961] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:36.207069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:36.208030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:36.214598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:36.215083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:36.215887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:36.216326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:36.246584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b5b05aa0-c122-4839-8269-7857874314e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043492 May 31 14:57:36.247167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 486/962] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:37.257554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:37.258504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:37.265040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:37.265494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:37.266253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:37.266716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:37.295224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-db4a7021-abfc-4bfa-8d73-ed199c6e7b44 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041638 May 31 14:57:37.295772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 477/963] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:38.307455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:38.308388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:38.315080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:38.315532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:38.316296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:38.316735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:38.346070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1908a13a-e08f-496f-afe1-e398554304cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042629 May 31 14:57:38.346627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 487/964] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:39.357566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:39.359046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:39.365545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:39.365998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:39.366861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:39.367304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:39.397343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0206701a-a7f8-4d0d-964f-4917145168e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043704 May 31 14:57:39.397902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 478/965] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:40.409140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:40.410057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:40.416947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:40.417392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:40.418142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:40.418573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:40.449025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-605cde08-f105-4ff7-ac26-ed8224a99b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044691 May 31 14:57:40.449590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 488/966] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:41.461399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:41.462308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:41.469317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:41.469764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:41.470524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:41.470985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:41.501850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-199c7868-05c0-4fff-805e-c3022e27398b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044349 May 31 14:57:41.502438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 479/967] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:42.513572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:42.514572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:42.521155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:42.521624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:42.522379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:42.522836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:42.552635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-90d5a29a-fb2d-4665-8c2a-39bed0a70cbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042986 May 31 14:57:42.553197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 489/968] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:43.565239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:43.566105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:43.572382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:43.572830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:43.573606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:43.574042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:43.604585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-355e6beb-32af-49bd-9129-8e2b5ef00734 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044105 May 31 14:57:43.605152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 480/969] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:44.615831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:44.616871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:44.623557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:44.624671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:44.625496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:44.625940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:44.655366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0b71df75-efdf-40f6-8426-c11dba4492b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043511 May 31 14:57:44.655925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 490/970] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:45.667231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:45.668160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:45.674741 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:45.675204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:45.676238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:45.676684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:45.710243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-58907bb8-5534-4e47-8a0d-ad8dfffaf2b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046888 May 31 14:57:45.710857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 481/971] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:46.722657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:46.723603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:46.730252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:46.730735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:46.731515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:46.731954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:46.763172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dfb371a2-7c8e-457e-9b21-85c13cfbc431 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044450 May 31 14:57:46.763751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 491/972] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:47.235513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:57:47.235757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:57:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:57:47.775282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:47.776211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:47.782876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:47.783336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:47.784119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:47.784564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:47.817488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6732f6e9-f01e-4847-947e-b099ccf7e311 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046194 May 31 14:57:47.818074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 482/973] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:48.830090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:48.830963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:48.837568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:48.838017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:48.838827 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:48.839266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:48.870635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7dc90354-b067-4a89-a154-7b73629ca259 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045142 May 31 14:57:48.871243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 492/974] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:49.882120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:49.883092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:49.889559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:49.890026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:49.890831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:49.891281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:49.920527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-588131f6-82b1-48f5-b712-fc78c702e6fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042364 May 31 14:57:49.921581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 483/975] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:50.932628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:50.933554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:50.940662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:50.941166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:50.941970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:50.942417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:50.975496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-047c9333-656d-4360-a002-c43f1e27a4a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046377 May 31 14:57:50.976088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 493/976] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:51.987286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:51.988199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:51.990471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:51.995813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:51.996261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:51.997033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:51.997465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:52.000608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:52.029776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-44dde780-595b-44da-8c7c-521842020bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046407 May 31 14:57:52.030349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 484/977] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:53.041509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:53.042430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:53.044834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:53.050163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:53.050899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:53.051663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:53.052100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:53.054618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:53.082376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d3bf1282-5af6-49b2-824f-eccf3a5944c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044795 May 31 14:57:53.082968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 494/978] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:54.093531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:54.094465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:54.101125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:54.101584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:54.102360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:54.102834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:54.133893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-45ddce14-a945-4f00-82f5-1db25df715f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044286 May 31 14:57:54.134481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 485/979] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:57:55.145526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:55.146469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:55.152887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:55.153332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:55.154080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:55.154512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:55.184153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5a1f7045-7e0c-4ef8-9ae2-7c092df0b1e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042597 May 31 14:57:55.184707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 495/980] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:56.196541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:56.197453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:56.204661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:56.205109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:56.205863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:56.206298 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:56.234863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-011e5b7e-8a8e-419a-a6c0-a679bbcce413 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042247 May 31 14:57:56.235413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 486/981] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:57.250910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:57.251892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:57.259437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:57.259897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:57.260690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:57.261141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:57.296867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d0445ada-5830-4e9e-9445-707dd13d4e82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051091 May 31 14:57:57.297485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 496/982] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:58.310350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:58.312179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:58.320749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:58.321212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:58.322002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:58.322446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:58.355398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-249452be-dba1-4ce3-804e-24b7f723b5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049520 May 31 14:57:58.355978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 487/983] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:57:59.368539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:57:59.369465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:57:59.376396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:59.376841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:59.377606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:57:59.378042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:57:59.412559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d5ad1c95-d576-40a7-a78b-b465d75f004e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048091 May 31 14:57:59.413146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 497/984] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:57:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:00.425687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:00.426616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:00.433242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:00.433692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:00.434456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:00.434931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:00.465937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a74a44f5-cfde-408c-92b0-db1b86d1f3e4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045086 May 31 14:58:00.466538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 488/985] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:01.477698 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:01.478619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:01.485141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:01.485595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:01.486363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:01.486838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:01.517159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b70b51bb-dd7a-4887-bc8b-09e36071c1e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043403 May 31 14:58:01.517728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 498/986] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:02.527851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:02.528772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:02.535246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:02.535701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:02.536464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:02.536903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:02.566745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b2f66ecf-f2d1-4f5c-bb81-fec377a6b134 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042805 May 31 14:58:02.567290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 489/987] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:03.578068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:03.578929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:03.585477 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:03.585923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:03.586705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:03.587145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:03.616390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5282029a-014c-4ae0-9318-ae2beac19810 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042908 May 31 14:58:03.616938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 499/988] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:04.628682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:04.629630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:04.636642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:04.637104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:04.637900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:04.638347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:04.671536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d20352d2-cb58-48a0-ab97-2d90dd3e8b88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046837 May 31 14:58:04.672126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 490/989] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:05.683563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:05.684566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:05.691087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:05.691548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:05.692316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:05.692756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:05.722638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bf835028-0446-40e4-b954-cd1a7d9ba4ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043023 May 31 14:58:05.723241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 500/990] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:06.734457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:06.735427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:06.741887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:06.742348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:06.743151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:06.743596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:06.774743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b1331a5a-a093-48a4-a400-27a87c996bbe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044178 May 31 14:58:06.775309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 491/991] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:07.786006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:07.786990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:07.794943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:07.795390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:07.796152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:07.796581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:07.827873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4a7be73a-7e7d-4620-a7e6-3589a8372d58 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045830 May 31 14:58:07.828431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 501/992] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:08.839745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:08.840561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:08.847054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:08.847509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:08.848279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:08.848722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:08.878521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1dd2f6e2-8854-43c3-88a5-41c721ca1eee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042951 May 31 14:58:08.879104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 492/993] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:09.890346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:09.891321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:09.897843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:09.898294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:09.899091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:09.899531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:09.930190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-677dbc3f-cb90-4d66-8c90-8b4a6fe49004 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043993 May 31 14:58:09.930873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 502/994] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:10.943039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:10.943996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:10.950702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:10.951172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:10.951990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:10.952437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:10.982118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-15cd70d4-4814-491e-9a4f-69571bf6c95b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043383 May 31 14:58:10.983200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 493/995] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:11.993624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:11.994553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:12.001677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:12.002133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:12.002925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:12.003363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:12.035845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-90e89545-e45e-48af-b748-82120fe08d4b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046099 May 31 14:58:12.036460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 503/996] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:13.048428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:13.049375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:13.056323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:13.056776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:13.057554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:13.057994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:13.088890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0ae716be-bbbc-4d8f-87b3-9815a1434979 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045008 May 31 14:58:13.089453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 494/997] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:14.100662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:14.101948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:14.109051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:14.109503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:14.110297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:14.110766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:14.145569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-58ce57f0-9e3e-47da-b553-e96a0de360bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048767 May 31 14:58:14.146189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 504/998] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:15.157518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:15.158467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:15.165149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:15.165598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:15.166369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:15.166845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:15.197705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-414fa971-8a77-4915-b392-66309b4f98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044171 May 31 14:58:15.198285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 495/999] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:16.209726 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:16.210683 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:16.217552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:16.217991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:16.218789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:16.219229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:16.250617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1544fdf9-f162-4443-a449-0912cbcfdf25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044967 May 31 14:58:16.251197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 505/1000] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:17.262231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:17.263194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:17.270384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:17.270895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:17.271676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:17.272114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:17.302188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-033290a3-a002-458f-a901-1c51b11d3eea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043875 May 31 14:58:17.302797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 496/1001] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:18.314083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:18.315045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:18.321663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:18.322118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:18.322916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:18.323473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:18.352567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-15d0bd80-541e-46b5-ba66-a412764cce6a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043012 May 31 14:58:18.353120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 506/1002] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:19.365119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:19.366046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:19.372210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:19.372665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:19.373433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:19.373869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:19.403197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-93169d61-fda1-4323-8d9b-e95f286d6d3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042346 May 31 14:58:19.403675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 497/1003] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:20.415480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:20.416316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:20.422910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:20.423361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:20.424127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:20.424561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:20.454962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3b75529b-6adf-4d01-b1e1-dd2d9d1f2d76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043429 May 31 14:58:20.455517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 507/1004] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:21.467394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:21.468267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:21.474732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:21.475188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:21.475948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:21.476391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:21.505047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d80b7708-dff3-44db-9594-134c3651732a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042364 May 31 14:58:21.505595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 498/1005] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:22.516869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:22.517781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:22.524330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:22.524772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:22.525522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:22.525951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:22.556271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-09552be7-f1b8-4e61-b17a-a32989354103 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043464 May 31 14:58:22.556825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 508/1006] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:23.567108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:23.568072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:23.570364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:23.576385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:23.576836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:23.577610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:23.578043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:23.580782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:23.611119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0372c03b-4fa8-41b8-ae40-424d78d68c4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047875 May 31 14:58:23.611710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 499/1007] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:24.623455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:24.624380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:24.626769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:24.632272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:24.632725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:24.633547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:24.633986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:24.636623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:24.664052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e73f77cc-7334-4b29-9ad5-56d46849b456 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045149 May 31 14:58:24.664608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 509/1008] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:25.676312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:25.677240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:25.683879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:25.684340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:25.685111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:25.686051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:25.715875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-663293f7-82a3-4c2a-9ab4-dbeb5572d59a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043797 May 31 14:58:25.716438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 500/1009] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:26.727657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:26.728579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:26.735238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:26.735687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:26.736531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:26.736942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:26.766413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9cd21aef-a4e8-4121-94b5-69f00c0e29d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042701 May 31 14:58:26.767013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 510/1010] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:27.777518 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:27.778525 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:27.785416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:27.785867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:27.786627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:27.787161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:27.816916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1095d729-7080-42f5-aaec-9136bba4142b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043346 May 31 14:58:27.817470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 501/1011] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:28.828608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:28.829517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:28.836332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:28.836784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:28.837537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:28.837975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:28.874853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6d2fb537-f833-40be-9a9a-4239e26ffba9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050021 May 31 14:58:28.875418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 511/1012] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:29.886481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:29.887457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:29.894411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:29.894901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:29.895672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:29.896111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:29.926411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0056766c-dbbf-4eac-b053-fe90ac397335 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043814 May 31 14:58:29.927017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 502/1013] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:30.938124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:30.939112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:30.945507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:30.945953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:30.946730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:30.947172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:30.977587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6f885ab3-d958-41d5-b52a-00333adb5129 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043424 May 31 14:58:30.978140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 512/1014] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:31.989305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:31.990315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:31.997077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:31.997558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:31.998374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:31.999353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:32.031490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-847c13f0-9d15-4cfe-b3cd-e26ecab0819d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046087 May 31 14:58:32.032077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 503/1015] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:33.043450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:33.044379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:33.051293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:33.051750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:33.052528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:33.052968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:33.087799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6840fc35-6e20-45c5-872a-0fa3a59908b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048266 May 31 14:58:33.088395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 513/1016] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:34.101258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:34.102182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:34.109495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:34.109948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:34.110757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:34.111200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:34.143497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab3a4901-bf02-414b-8a9d-a6c8ce14c144 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046194 May 31 14:58:34.144084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 504/1017] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:35.155561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:35.156492 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:35.163275 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:35.163736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:35.164508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:35.164943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:35.198036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-318589bf-00b8-411b-a503-0654a0b1a5b2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046917 May 31 14:58:35.198673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 514/1018] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:36.210047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:36.211017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:36.218438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:36.218916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:36.219703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:36.220152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:36.253080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a888e524-a586-49c7-88d6-4cb228ab6ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046968 May 31 14:58:36.253663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 505/1019] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:37.266393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:37.267417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:37.274917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:37.275374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:37.276368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:37.276819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:37.313362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-96f6d4b7-489a-42e5-b145-4a727307defb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051781 May 31 14:58:37.313974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 515/1020] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:38.087865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:58:38.088451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 14:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:58:38.284245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 14:58:38.284876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 14:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 14:58:38.325334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:38.326260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:38.332885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:38.333335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:38.334105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:38.334548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:38.367551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7570bb68-c3a9-4f55-bc8d-5dde2641ce91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046140 May 31 14:58:38.368107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 506/1021] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:39.379012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:39.379942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:39.387482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:39.388439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:39.389208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:39.389650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:39.420607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8e540fb0-84c0-424e-8010-f0efb85a0bab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045529 May 31 14:58:39.421190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 516/1022] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:40.433038 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:40.433963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:40.440875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:40.441335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:40.442121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:40.442567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:40.474681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ad58731a-c310-4bc3-b6cc-4ffd86ed1ef2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045506 May 31 14:58:40.475302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 507/1023] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:41.486469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:41.487416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:41.493864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:41.494320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:41.495108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:41.495541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:41.523945 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0f28e74f-a8e3-457b-a96a-ac0581baef3b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042024 May 31 14:58:41.524490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 517/1024] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:42.536333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:42.537273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:42.544126 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:42.544584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:42.545351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:42.545790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:42.575961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-859d009e-327f-4a0f-9ad3-7e5aaca2ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043285 May 31 14:58:42.576816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 508/1025] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:43.588154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:43.588986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:43.596101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:43.596554 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:43.597320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:43.597757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:43.628078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c50e0036-37fa-43d7-a97c-30f9a394fed6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044004 May 31 14:58:43.628645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 518/1026] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:44.641589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:44.642632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:44.652212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:44.652977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:44.654969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:44.655726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:44.708896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-05d9eeea-8330-4d43-a03c-6d29badb5b81 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071846 May 31 14:58:44.709850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 509/1027] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:45.965406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:45.966551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:45.972940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:45.973452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:45.974170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:45.974602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:46.028457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1ab4070-d617-4fad-8709-786f8ee44ab3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.311126 May 31 14:58:46.029442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 519/1028] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:47.041419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:47.042502 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:47.050012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:47.050473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:47.051291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:47.051731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:47.083373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a81f800e-bba0-462d-b243-92aa226c512a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046410 May 31 14:58:47.083955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 510/1029] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:48.096219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:48.097332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:48.104017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:48.104471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:48.105248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:48.105687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:48.138186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f4b04720-e0a7-43c6-91d3-686c02f3a6b5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045933 May 31 14:58:48.138774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 520/1030] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:49.149972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:49.150944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:49.158326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:49.158858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:49.159652 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:49.160084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:49.192896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a06b2d9b-c62f-447e-9eba-14e5f2561f88 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047143 May 31 14:58:49.193478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 511/1031] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:50.205144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:50.206088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:50.213552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:50.213988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:50.214860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:50.215302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:50.250973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d0b966a1-d8d4-4f63-ace9-9bd732a2e5a7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049626 May 31 14:58:50.251462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 521/1032] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:51.262205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:51.263233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:51.270274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:51.270770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:51.271557 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:51.272007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:51.306455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0750557a-3a6a-4a6e-b41a-2244475207c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048197 May 31 14:58:51.307151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 512/1033] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:52.322878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:52.324829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:52.337044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:52.337915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:52.339425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:52.340191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:52.388007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e51ca893-7084-4723-b09b-8a28514fd55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071666 May 31 14:58:52.388755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 522/1034] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:53.402447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:53.403589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:53.411096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:53.411644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:53.412511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:53.413098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:53.467850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bffe1489-3490-45db-a06d-f8ef629e74cf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069289 May 31 14:58:53.468727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 513/1035] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:54.480654 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:54.482020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:54.490440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:54.490916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:54.491700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:54.492141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:54.526900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-37d0e951-6204-4067-80e5-ea7280606032 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050234 May 31 14:58:54.527486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 523/1036] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:55.540274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:55.541092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:55.543531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:55.549590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:55.550061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:55.550907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:55.551353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:55.554289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:55.587171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-edf694ba-bd49-4e0f-bd7e-a92ee08ebac2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050888 May 31 14:58:55.587753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 514/1037] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:56.599502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:56.600525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:56.603269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:56.609489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:56.609942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:56.610763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:56.611206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:56.614323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:56.647081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4ef7f2b8-81a0-468d-8fd5-eea0e423c84e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051768 May 31 14:58:56.647590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 524/1038] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:57.661117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:57.662023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:57.672951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:57.673850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:57.675629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:57.676494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:57.712625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-09006104-77a1-48d7-8bad-ed85aa0cb473 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055922 May 31 14:58:57.713206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 515/1039] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:58:58.724735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:58.725703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:58.733657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:58.734179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:58.735127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:58.735670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:58.767610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-639c0e1d-06ed-47a2-a481-f44525cbdc83 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046767 May 31 14:58:58.768192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 525/1040] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:58:59.779782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:58:59.780720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:58:59.787726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:59.788181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:59.788971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:58:59.789417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:58:59.823864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37e7c9c3-f773-4f47-9138-a5dc256d5869 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047985 May 31 14:58:59.824456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 516/1041] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:58:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:00.835919 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:00.836892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:00.843743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:00.844197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:00.844990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:00.845429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:00.880693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-00148943-74cb-4e6b-9830-c9df56bfd49f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048605 May 31 14:59:00.881196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 526/1042] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:01.893476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:01.894783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:01.902870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:01.903346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:01.904208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:01.904668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:01.940408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5d42a08f-7b6a-406e-8a2e-89d6b4892165 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051354 May 31 14:59:01.940903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 517/1043] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:02.953789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:02.954812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:02.961962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:02.962407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:02.963291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:02.963733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:03.002010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d60202c5-bcb0-436f-841f-cbc7cce55e8b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052593 May 31 14:59:03.002995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 527/1044] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:04.015621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:04.016615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:04.023835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:04.024160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:04.024967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:04.025409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:04.077984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-989ae9ce-85d4-4e39-8a4d-1e4edb371101 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066572 May 31 14:59:04.078581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 518/1045] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:05.089913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:05.091344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:05.098144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:05.098597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:05.099408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:05.099847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:05.134085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-88e7db70-3c27-4c37-9fde-a76d08ef2153 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048221 May 31 14:59:05.134713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 528/1046] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:06.149169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:06.150789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:06.162369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:06.163177 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:06.164516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:06.165280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:06.220219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f4db725d-3b9f-453d-90bd-df6c38ea3693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077868 May 31 14:59:06.221105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 519/1047] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:07.234728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:07.235650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:07.242612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:07.243093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:07.243907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:07.244346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:07.278495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-de1bfb00-4a9e-49a2-be23-125210b9df5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047206 May 31 14:59:07.279144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 529/1048] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:08.291101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:08.291932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:08.299792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:08.300249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:08.301032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:08.301475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:08.333336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-684e05e0-cd3a-42bd-93bf-0ce8e56a00e7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046552 May 31 14:59:08.333967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 520/1049] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:09.345591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:09.346583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:09.355409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:09.356969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:09.358126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:09.359022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:09.396770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c6443058-8a19-472a-9d73-e33fbabadbb7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055271 May 31 14:59:09.397386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 530/1050] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:10.409330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:10.410309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:10.417187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:10.417646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:10.419079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:10.419530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:10.450877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-adec008e-b8de-4c90-8879-a63f32655041 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045642 May 31 14:59:10.451455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 521/1051] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:11.462521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:11.463539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:11.470111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:11.470564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:11.471374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:11.471819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:11.505125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-36d1e210-d4f3-4605-b5b4-ef0e143cf056 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046743 May 31 14:59:11.505720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 531/1052] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:12.517615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:12.518596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:12.525627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:12.526085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:12.526902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:12.527354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:12.562157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b831fffb-dba4-44f8-8c27-4252dfe5206a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048487 May 31 14:59:12.562759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 522/1053] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:13.574359 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:13.575674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:13.584444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:13.584879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:13.585671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:13.586110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:13.618915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-109dcdb9-ec14-4874-987b-6bde903f951c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048633 May 31 14:59:13.619500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 532/1054] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:14.633439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:14.634405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:14.641821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:14.642192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:14.643017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:14.643470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:14.676603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cbfa0e4a-fe57-4fee-a959-d2b7b05ece92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047533 May 31 14:59:14.677199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 523/1055] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:15.689402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:15.690299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:15.696616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:15.697068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:15.697856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:15.698294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:15.731261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c2a1e4d3-6b6f-448a-8249-e9772e95e9e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046033 May 31 14:59:15.731856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 533/1056] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:16.744353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:16.745251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:16.753862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:16.754370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:16.755351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:16.755852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:16.791491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4ee5e200-9bac-441b-827c-276d44f5aeb1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051525 May 31 14:59:16.792171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 524/1057] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:17.804314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:17.805259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:17.812516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:17.813023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:17.813851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:17.814388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:17.848540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cb36335e-69bb-479c-b4c2-deacd6b39c2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048282 May 31 14:59:17.849256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 534/1058] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:18.864326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:18.865892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:18.878179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:18.878945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:18.880218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:18.880987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:18.939526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3079190-6e53-4a68-a9a0-173f0db22212 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081943 May 31 14:59:18.940568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 525/1059] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:19.954914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:19.955779 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:19.962850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:19.963358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:19.964076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:19.964822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:19.997991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dc0b655c-a868-4b61-824e-171d4e491b3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047435 May 31 14:59:19.999078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 535/1060] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:21.014528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:21.017168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:21.028343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:21.029470 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:21.031053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:21.032030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:21.090457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9b4d8ee6-6018-4889-a789-59e9b0110715 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.082874 May 31 14:59:21.091948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 526/1061] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:22.105632 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:22.106600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:22.113570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.114020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.114860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.115306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.154422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b2b4e05a-18f6-483f-8448-198ec1de6fc6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053097 May 31 14:59:22.155345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 536/1062] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:22.797676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:22.798377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:22.807952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.809507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.810538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.811020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.843802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 14:59:22.891781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-3c57e4b7-1f72-4a1d-b7af-35824f298ff2 req-6ada8cc0-7ac8-4345-bef9-5bbf6e0d7e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83ddc26-cae5-4b25-8814-b23ca0401cfc", "tag": "6ffece83-3725-4891-bdaa-7796a0315252"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:59:22.900493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3c57e4b7-1f72-4a1d-b7af-35824f298ff2 req-6ada8cc0-7ac8-4345-bef9-5bbf6e0d7e62 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.901201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3c57e4b7-1f72-4a1d-b7af-35824f298ff2 req-6ada8cc0-7ac8-4345-bef9-5bbf6e0d7e62 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.914150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-3c57e4b7-1f72-4a1d-b7af-35824f298ff2 req-6ada8cc0-7ac8-4345-bef9-5bbf6e0d7e62 service nova] Creating event network-changed:6ffece83-3725-4891-bdaa-7796a0315252 for instance a83ddc26-cae5-4b25-8814-b23ca0401cfc on hv-cinder-83979 May 31 14:59:22.923438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-3c57e4b7-1f72-4a1d-b7af-35824f298ff2 req-6ada8cc0-7ac8-4345-bef9-5bbf6e0d7e62 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126806 May 31 14:59:22.924651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 537/1063] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:22.958529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-56837e23-e102-4a3c-b024-76b27f8c759c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 204 len: 0 microversion: 2.1 time: 0.164863 May 31 14:59:22.963309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 527/1064] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 14:59:22 2022] DELETE /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 14:59:22.973287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:22.974531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:22.984876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.985610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:22.986861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:22.987535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:23.166287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:23.167354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:23.175408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:23.175872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:23.176657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:23.177093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:23.217678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-30f8cd2d-cd44-4c0c-b92b-6e7ad957ae47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055758 May 31 14:59:23.218850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 528/1065] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:23.328793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:23.337181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5c344919-f347-4a93-aa69-a5d47895d769 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1579 microversion: 2.1 time: 0.371911 May 31 14:59:23.350684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 538/1066] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1579 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:24.231266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:24.232385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:24.239975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:24.240469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:24.241301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:24.241782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:24.244663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:24.276620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-543e63d9-9268-4896-9df6-ed480f1850ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049385 May 31 14:59:24.277458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 529/1067] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:24.363430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:24.364300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:24.373206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:24.373743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:24.374627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:24.375277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:24.446689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:24.456962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f1055c55-5d80-47dd-b1ff-38f58ec17095 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1392 microversion: 2.1 time: 0.098073 May 31 14:59:24.457552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 539/1068] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1392 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:24.940044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-654d91de-870c-46d8-a0c3-e949f809df39 req-251e23e6-7736-4f57-a93f-0fb857e91693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83ddc26-cae5-4b25-8814-b23ca0401cfc", "name": "network-vif-deleted", "tag": "6ffece83-3725-4891-bdaa-7796a0315252"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 14:59:24.948340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-654d91de-870c-46d8-a0c3-e949f809df39 req-251e23e6-7736-4f57-a93f-0fb857e91693 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:24.948819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-654d91de-870c-46d8-a0c3-e949f809df39 req-251e23e6-7736-4f57-a93f-0fb857e91693 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:24.961018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-654d91de-870c-46d8-a0c3-e949f809df39 req-251e23e6-7736-4f57-a93f-0fb857e91693 service nova] Creating event network-vif-deleted:6ffece83-3725-4891-bdaa-7796a0315252 for instance a83ddc26-cae5-4b25-8814-b23ca0401cfc on hv-cinder-83979 May 31 14:59:24.966371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-654d91de-870c-46d8-a0c3-e949f809df39 req-251e23e6-7736-4f57-a93f-0fb857e91693 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030020 May 31 14:59:24.967021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 530/1069] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 14:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:25.288589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:25.289527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:25.296407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:25.296858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:25.297634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:25.298116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:25.330330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d37f60b0-c9ca-48d7-a2b9-8770781fcd7c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045712 May 31 14:59:25.330945 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 540/1070] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:25.475339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:25.476021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:25.483961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:25.484440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:25.485262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:25.485732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:25.600245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:25.608705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-13c445f1-c2fe-470b-91da-e8729b019228 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.137768 May 31 14:59:25.609291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 531/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:25 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:26.342547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:26.343525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:26.350277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:26.350782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:26.351566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:26.352005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:26.366757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:26.384739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cc45e62c-f73c-414d-bc70-a8b9847cd08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046371 May 31 14:59:26.385324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 541/1072] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:26.626147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:26.626985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:26.629721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:26.635945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:26.636405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:26.637216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:26.637658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:26.703722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:26.711760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-53c73a4e-5058-4439-a997-02df5f29db4e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089473 May 31 14:59:26.712347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 532/1073] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:27.397676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:27.398530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:27.401070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=36 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:27.407847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:27.408358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:27.409318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:27.409813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:27.442673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d81734fc-538d-4079-819f-08d711139b98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049189 May 31 14:59:27.443293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 542/1074] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:27.729246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:27.729830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:27.736760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:27.737230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:27.738020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:27.738467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:27.830333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:27.838907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9f21fe73-28b2-4308-aa57-104638a27d2d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.113683 May 31 14:59:27.839493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 533/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:27 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:28.454887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:28.455787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:28.462772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:28.463230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:28.464016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:28.464456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:28.500508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7ba113f3-5fbe-4369-9015-a3217b36950c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049727 May 31 14:59:28.501091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 543/1076] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:28.857129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:28.857733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:28.865154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:28.865604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:28.866388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:28.866856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:28.931317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:28.940337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3cd59d20-fc9f-46b1-ac21-95b3a718c7f7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087655 May 31 14:59:28.940987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 534/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:29.513584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:29.514424 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:29.521627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:29.522075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:29.522894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:29.523330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:29.555988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ffd2aad4-bbaf-4c3a-b734-dd039b8bdfae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047239 May 31 14:59:29.556640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 544/1078] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:29.957721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:29.958342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:29.965968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:29.966420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:29.967248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:29.967696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:30.033699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:30.041763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-324f4fd2-cc0b-4850-8adc-40cfb7e6bce5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087950 May 31 14:59:30.042366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 535/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:29 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:30.568979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:30.569915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:30.577358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:30.577803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:30.578581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:30.579046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:30.614604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-993a2f5b-1466-4cc3-8026-c3f78c641f50 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049914 May 31 14:59:30.615310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 545/1080] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:31.067547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:31.068573 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:31.076313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:31.076763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:31.077544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:31.077986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:31.143488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:31.151595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a13178e8-8084-497f-9371-bc2d2f93a4ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087941 May 31 14:59:31.152803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 536/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:31 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:31.627868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:31.628819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:31.635984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:31.637055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:31.637860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:31.638308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:31.671372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b526f9b8-c21d-4e78-9cfd-a2e28ee7a2ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047764 May 31 14:59:31.671962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 546/1082] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:32.170939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:32.172026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:32.179813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:32.180269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:32.181053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:32.181496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:32.259174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:32.267585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-008e5e03-6dd8-4311-a6ca-4f805ac408cd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101717 May 31 14:59:32.268183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 537/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:32.683815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:32.685162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:32.691974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:32.693069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:32.693866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:32.694307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:32.732360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dcbc1533-52cc-42d6-a8e2-f523a921dbb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052596 May 31 14:59:32.732939 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 547/1084] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:33.285474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:33.286147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:33.294074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:33.294523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:33.295335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:33.295770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:33.360707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:33.368575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab368474-189e-4201-bc28-5354f9c5aa23 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086998 May 31 14:59:33.369159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 538/1085] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:33 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:33.744386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:33.745298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:33.755957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:33.756405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:33.757188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:33.757620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:33.792168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8343ba53-e0d5-440a-9751-54b292d0a682 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051786 May 31 14:59:33.793337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 548/1086] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:34.386855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:34.387720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:34.394080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:34.394529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:34.395334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:34.395773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:34.496672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:34.505262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-264017a6-7978-4bb5-a11a-394496c39b77 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.123036 May 31 14:59:34.505872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 539/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:34.807713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:34.809108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:34.815850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:34.816297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:34.817069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:34.817502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:34.849393 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c868d58b-0981-4afa-ba9b-9b082c0ccfdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045715 May 31 14:59:34.849973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 549/1088] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:35.523268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:35.523854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:35.531117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:35.531580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:35.532366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:35.532814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:35.604984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:35.612953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a2932d67-5b99-42d4-84ba-391f752697f4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093645 May 31 14:59:35.613531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 540/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:35.861446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:35.862456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:35.869511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:35.869963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:35.870854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:35.871300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:35.905772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-beb43ed5-ded7-49cc-8138-dc35308d4c27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048415 May 31 14:59:35.906362 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 550/1090] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:36.629899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:36.630507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:36.638202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:36.638682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:36.639474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:36.639920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:36.708530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:36.717193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ae420bb7-45f1-41b9-a885-89f289799f34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091092 May 31 14:59:36.717771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 541/1091] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:36 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:36.918412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:36.919311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:36.926499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:36.926983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:36.927783 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:36.928223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:36.963482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b1dc6683-f2ae-41c3-bcff-6fcec8c46f65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049544 May 31 14:59:36.964083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 551/1092] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:37.734983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:37.735669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:37.742617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:37.743116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:37.744212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:37.744662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:37.813123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:37.821082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-821ee5f9-248e-4c73-8d45-f65125f63fdf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090007 May 31 14:59:37.821678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 542/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:37 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:37.978515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:37.980576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:37.991310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:37.991916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:37.993213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:37.993869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:38.031010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e207ab14-0fe3-4873-9138-9519e5f3c8e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058934 May 31 14:59:38.031622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 552/1094] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:38.840488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:38.841084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:38.847873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:38.848335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:38.849124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:38.849573 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:38.913196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:38.921646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-261ad913-5501-49f6-a9ba-1b9d9c0a8ac4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085680 May 31 14:59:38.922265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 543/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:39.043789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:39.044829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:39.052432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:39.052885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:39.053678 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:39.054110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:39.088037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dbd9b8e5-14da-4699-99c5-045a3933d0f6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049006 May 31 14:59:39.088729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 553/1096] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:39.939534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:39.940248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:39.946995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:39.947456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:39.948243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:39.948689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:40.013322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:40.021698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1935082c-6721-4297-8684-fcdfccba94fa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086159 May 31 14:59:40.022290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 544/1097] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:40.100597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:40.101560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:40.108417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:40.108872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:40.109660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:40.110092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:40.142713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c4382f27-e141-4c32-ac92-629008829807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045994 May 31 14:59:40.143611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 554/1098] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:41.039607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:41.040521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:41.046915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:41.047375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:41.048154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:41.048598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:41.122234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:41.133277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6c287bd1-76b8-47e9-83fa-e011e3210120 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.097623 May 31 14:59:41.134922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 545/1099] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:41.155302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:41.156634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:41.163607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:41.164061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:41.164842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:41.165280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:41.197998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8dc4ae46-5e2b-4b54-ac1d-84ea83ce34d4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047559 May 31 14:59:41.198620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 555/1100] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:42.153823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:42.154495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:42.161468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:42.161969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:42.162989 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:42.163480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:42.184274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:42.210200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:42.211354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:42.218908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:42.221021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:42.221021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:42.221640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:42.238501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:42.249541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8b9a2a87-af1d-491f-a5b7-64de477d213d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100597 May 31 14:59:42.250328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 546/1101] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:42 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:42.272664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-55f4fe82-fbd4-45d4-a6b6-e612bb5b318c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066632 May 31 14:59:42.273983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 556/1102] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:43.267870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:43.268596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:43.275579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:43.276124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:43.277041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:43.277551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:43.288379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:43.289509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:43.298320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:43.299333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:43.300512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:43.301249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:43.338364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d887d091-1bab-4f46-8e19-639eed82c55c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055122 May 31 14:59:43.339166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 557/1103] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:43.356611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:43.370988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f9311b4d-3195-4741-ada6-3dd3d1d8a2f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.106268 May 31 14:59:43.372065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 547/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:44.350603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:44.351485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:44.358495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:44.358980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:44.359806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:44.360249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:44.362953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:44.393397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2f6c1ef4-1ccb-483d-99aa-2c7b1333e340 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047045 May 31 14:59:44.393979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 558/1105] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:44.397485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:44.398532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:44.406227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:44.406696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:44.407500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:44.407931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:44.474434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:44.483440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-980827f2-142c-416b-ba08-dc4cd7750b4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090497 May 31 14:59:44.484020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 548/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:44 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:45.407180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:45.408115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:45.415710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:45.416240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:45.417088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:45.418049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:45.451137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d5aeac65-4aa1-4c23-ba1b-aedb49822697 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048056 May 31 14:59:45.451716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 559/1107] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:45.508326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:45.509023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:45.517270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:45.517779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:45.518611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:45.519127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:45.588899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:45.597242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f9a90c6f-1536-4585-b6fd-0a16c0b2c56d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092813 May 31 14:59:45.597837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 549/1108] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:46.463510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:46.465007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:46.471815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:46.472303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:46.473125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:46.473599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:46.505371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-62d68bda-8d7f-4cf3-bd95-cb4edf905192 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045953 May 31 14:59:46.506003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 560/1109] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:46.615318 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:46.615987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:46.622591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:46.623086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:46.623864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:46.624308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:46.688858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:46.702755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7e57322c-f958-4d4a-b5c0-669710b00e63 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091014 May 31 14:59:46.703816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 550/1110] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:46 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:47.518705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:47.519583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:47.526900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:47.527357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:47.528159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:47.528604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:47.564757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8baf46a4-10cb-470b-93c7-270a494a7459 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050071 May 31 14:59:47.565355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 561/1111] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:47.728648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:47.729297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:47.736459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:47.737034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:47.737711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:47.738159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:47.803369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:47.811417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5bfed7eb-917d-4453-a961-9a7b225879a6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086578 May 31 14:59:47.812008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 551/1112] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:48.577067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:48.577910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:48.584648 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:48.585099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:48.585878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:48.586320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:48.617871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b15fd700-85af-4814-a5f5-49b7d3895e91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044846 May 31 14:59:48.618447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 562/1113] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:48.829201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:48.829753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:48.836456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:48.836918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:48.837699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:48.838153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:48.903104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:48.910961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-864a6675-9b85-4736-a824-daa3a57aa01c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085590 May 31 14:59:48.911796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 552/1114] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:49.630366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:49.631348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:49.638250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:49.638732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:49.639513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:49.639954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:49.672971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1befd674-4390-4c03-a01e-bab7edbc23f7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046584 May 31 14:59:49.673812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 563/1115] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:49.928797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:49.929372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:49.936215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:49.936659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:49.937437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:49.937872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:50.007788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:50.021173 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e03d78e8-2877-4796-9ac4-8df943791f25 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.096463 May 31 14:59:50.021759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 553/1116] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:50.686337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:50.687273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:50.694179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:50.694636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:50.695425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:50.695861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:50.727436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4eabf27f-2ff6-462c-9543-ba9d1367fa01 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045941 May 31 14:59:50.728020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 564/1117] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:51.039036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:51.039611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:51.046833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:51.047285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:51.048053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:51.048490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:51.112510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:51.120335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a7c2af83-92ad-458c-a83f-c1a15dfcce59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085193 May 31 14:59:51.121262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 554/1118] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:51.740754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:51.741817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:51.749262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:51.749758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:51.750770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:51.751246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:51.784001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cf924f49-cb7d-4ae4-9a03-cd75a067837b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047774 May 31 14:59:51.784645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 565/1119] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:52.137787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:52.138511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:52.145602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:52.146098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:52.146974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:52.147497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:52.219843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:52.234531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2abfafb6-6442-412f-a554-808f2a7a0533 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100168 May 31 14:59:52.235597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 555/1120] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:52.797012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:52.798135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:52.805481 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:52.805923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:52.806743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:52.807178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:52.841925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-026489e9-09fb-4e7f-ba5f-7d01e65178ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049519 May 31 14:59:52.842665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 566/1121] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:53.261738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:53.262361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:53.269847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:53.270303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:53.271145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:53.271597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:53.338870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:53.347177 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5c3ff2a1-0716-43c4-885d-5fb10ad90130 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089923 May 31 14:59:53.347806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 556/1122] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:53 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:53.853868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:53.855423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:53.862868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:53.863376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:53.864184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:53.864652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:53.895662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7ec89232-b5fd-404f-9257-67f2e543ee43 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045752 May 31 14:59:53.896298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 567/1123] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 14:59:54.365321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:54.366348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:54.376709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:54.377434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:54.379106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:54.379713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:54.469057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:54.478957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f6518d12-0436-445c-aa67-0b4ce2d47f15 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.117670 May 31 14:59:54.480012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 557/1124] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 14:59:54.907833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:54.908776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:54.916377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:54.916836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:54.917624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:54.918065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:54.951045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c7979158-45ea-4892-a455-10974c4f7057 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047180 May 31 14:59:54.951635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 568/1125] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:55.502863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:55.503698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:55.510082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:55.510527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:55.511328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:55.511762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:55.789748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:55.798114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-56b94b19-85bf-470d-8bf9-f73c2bc13953 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.299288 May 31 14:59:55.798970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 558/1126] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:55.962700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:55.963637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:55.971065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:55.971520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:55.972305 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:55.972744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:56.003370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a0803c37-addc-4493-a803-63ffe6a7a363 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044588 May 31 14:59:56.003935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 569/1127] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:56.819567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:56.820302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:56.822805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=54 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:56.829616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:56.830069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:56.830914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:56.831359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:56.900028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:56.909046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-392b69f1-2f78-4750-96b8-fc80ea45fb34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093489 May 31 14:59:56.909641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 559/1128] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:57.016215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:57.017477 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:57.024924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:57.025373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:57.026162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:57.026602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:57.081303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bcd14acc-2a66-47d7-a9c6-c0827495f271 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068571 May 31 14:59:57.082273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 570/1129] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:57.927994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:57.928604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:57.935503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:57.935953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:57.938259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:57.938259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:58.010394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:58.023261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-94b75c48-44d9-4f02-ac76-fe9d2e1676ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099218 May 31 14:59:58.024194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 560/1130] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:58.095902 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:58.097066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:58.100090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=58 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:58.106573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:58.107131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:58.107988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:58.108470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:58.144692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-90380a48-9f63-425d-a48e-bae3a817c500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052957 May 31 14:59:58.145290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 571/1131] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 14:59:59.042455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:59.043303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:59.050749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:59.051212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:59.052005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:59.052447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:59.121665 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 14:59:59.133044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b39d2669-7fac-4a33-a4a0-387e35c35b86 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095275 May 31 14:59:59.133713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 561/1132] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 14:59:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 14:59:59.157629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 14:59:59.158571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 14:59:59.165777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:59.166275 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:59.167748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 14:59:59.168234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 14:59:59.203509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f7e3b25b-c086-43f6-bfa4-def9084cf693 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049928 May 31 14:59:59.204215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 572/1133] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 14:59:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:00:00.154554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:00.155709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:00.167250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:00.168058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:00.169436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:00.170214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:00.216168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:00.217130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:00.224286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:00.224740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:00.225542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:00.225985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:00.271826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:00.280833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-616b7593-43d7-4941-8968-885b2bdc6a6b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.133655 May 31 15:00:00.281434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 562/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:00.283998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d34f2b72-89c3-4935-a26c-5bbc4c5f887a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071554 May 31 15:00:00.285075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 573/1135] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:00:01.299490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:01.300378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:01.301132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:01.301319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:01.308914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:01.309374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:01.309838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:01.310308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:01.310490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:01.311150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:01.311328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:01.311829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:01.314942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:01.362945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-41fcf823-e723-4b69-af28-63c42920afab tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068078 May 31 15:00:01.363737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 563/1136] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:01.399987 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:01.402798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:01.411257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e5ab2c81-2f46-4860-8a62-52b8c630da35 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.115017 May 31 15:00:01.411873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 574/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:02.375556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:02.376509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:02.383895 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:02.384256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:02.385056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:02.385498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:02.420444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f1844b82-397d-4155-b8b5-a583984b8a63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048980 May 31 15:00:02.421050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 564/1138] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:00:02.429249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:02.429886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:02.437252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:02.437707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:02.438511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:02.439003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:02.504869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:02.513180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3b7409b2-c7e4-4bf0-8757-8f92a88d471f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087875 May 31 15:00:02.513781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 575/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:03.432891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:03.433722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:03.440582 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:03.441030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:03.441797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:03.442231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:03.474288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-feb22dac-0b34-4a88-ba40-d178a3fdb92a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045431 May 31 15:00:03.474892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 565/1140] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:03.539257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:03.539895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:03.547266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:03.547721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:03.548769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:03.549210 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:03.612768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:03.620639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2f12020f-9794-4520-84e8-d9e71795feff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085500 May 31 15:00:03.621229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 576/1141] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:04.486792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:04.487710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:04.495003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:04.495473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:04.496291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:04.496739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:04.532056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ad9471c2-6e0c-474e-96d1-14ba544a4b9d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049409 May 31 15:00:04.532668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 566/1142] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:04.645598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:04.646355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:04.653894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:04.654419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:04.655487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:04.656062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:04.734331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:04.742635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f53b2f29-8c8c-42a0-b854-70b4e1466f3d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100911 May 31 15:00:04.743158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 577/1143] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:04 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:05.544968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:05.545797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:05.552964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:05.553418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:05.554206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:05.554673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:05.586660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-65010ca5-e8b9-4837-8711-c38bdca429ae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046307 May 31 15:00:05.587267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 567/1144] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:05.765703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:05.766576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:05.773180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:05.773630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:05.774412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:05.774968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:05.839564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:05.847982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ae4485e4-4c8d-4a84-a14a-352ab839e1cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086241 May 31 15:00:05.848578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 578/1145] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:06.599406 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:06.600594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:06.607785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:06.608322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:06.609152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:06.609668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:06.642520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4c8a4d85-bba3-42cf-9ac7-bd5b1041376f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047438 May 31 15:00:06.643300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 568/1146] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:00:06.874601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:06.875459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:06.883136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:06.883638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:06.884461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:06.884999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:06.952080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:06.959993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bb3f58c6-592c-43bc-b6b3-509cd4617a8c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089988 May 31 15:00:06.960584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 579/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:07.655002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:07.655974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:07.662964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:07.663427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:07.664243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:07.664693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:07.700776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-35a44967-3cae-4973-bd30-1f680b2df8f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049888 May 31 15:00:07.701382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 569/1148] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:07.980529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:07.981388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:07.992159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:07.992856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:07.994103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:07.995396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:08.080459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:08.089572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a81a69e9-5ef8-4bc7-a601-737084bf7219 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.115704 May 31 15:00:08.090365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 580/1149] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:08.712899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:08.714423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:08.721228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:08.721719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:08.722534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:08.723041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:08.755546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2fde2d00-d9f2-4b91-aed6-dfe296cba450 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046610 May 31 15:00:08.756119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 570/1150] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:09.106995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:09.107703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:09.114842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:09.115299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:09.116099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:09.116556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:09.190256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:09.199529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c2bd297f-5efc-4512-b67e-b385fcd232e6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.096591 May 31 15:00:09.200128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 581/1151] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:09 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:09.769227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:09.770110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:09.778224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:09.778781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:09.779648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:09.780145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:09.814336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-658818b2-02fe-4faa-9fd2-434e4184fe2e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049520 May 31 15:00:09.814967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 571/1152] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:00:10.218559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:10.219311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:10.226401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:10.226891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:10.227679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:10.228124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:10.296353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:10.305115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-aab9fe8c-2779-45b0-a063-9ee8a1e44cb5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091861 May 31 15:00:10.305728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 582/1153] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:10.826247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:10.827347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:10.837013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:10.838012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:10.840140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:10.841118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:10.901519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5bb0496a-1e19-4d59-8468-7721d483b7fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079272 May 31 15:00:10.902585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 572/1154] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:00:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:00:11.331611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:11.332197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:11.339989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:11.340443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:11.341236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:11.341676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:11.407649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:11.415454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4c97edcd-8240-4c90-96bd-e60bacccdea1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088142 May 31 15:00:11.416049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 583/1155] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:11.915991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:00:11.917037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:11.924301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:11.924792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:11.925593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:11.926043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:11.998377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-afc779d2-a251-4b3f-8205-9f813886ca2f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/action" status: 200 len: 41331 microversion: 2.1 time: 0.086247 May 31 15:00:11.999077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 573/1156] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 15:00:11 2022] POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/action => generated 41331 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 15:00:12.437642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:12.438956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:12.450262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:12.450914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:12.452527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:12.452710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:12.520318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:12.529244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-603c25dd-eda6-4582-8325-2b0388e0ebbe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099158 May 31 15:00:12.529832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 584/1157] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:13.548022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:13.548991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:13.556388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:13.556849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:13.557636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:13.558082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:13.629422 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:13.642675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bf6b31c2-b3cc-46c6-9c23-37b728a66fa5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.098530 May 31 15:00:13.643709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 574/1158] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:13 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:14.661671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:14.662320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:14.669130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:14.669636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:14.670457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:14.670979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:14.742469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:14.751773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6e38bfa4-9107-441c-9be2-f74b07ccc985 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094082 May 31 15:00:14.752440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 585/1159] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:14 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:15.770511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:15.771181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:15.778769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:15.779270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:15.780101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:15.780585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:15.847003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:15.856317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-504c356e-5786-4260-8314-79f1708b45da tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089711 May 31 15:00:15.856908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 575/1160] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:15 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:16.874264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:16.874972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:16.882011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:16.882467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:16.883293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:16.883737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:16.951922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:16.960332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d5d16d82-c6d6-4c3a-8882-5578dda712e5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090603 May 31 15:00:16.961035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 586/1161] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:17.977682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:17.978365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:17.985330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:17.985793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:17.986594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:17.987072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:18.053483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:18.062457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4fb4f959-95cd-44a0-9a5c-44183c45f7bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088731 May 31 15:00:18.063074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 576/1162] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:19.079900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:19.080773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:19.088281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:19.088817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:19.089652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:19.090136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:19.166980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:19.175540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ac59c225-bd90-467d-9e0d-46165f348edd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099548 May 31 15:00:19.176185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 587/1163] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:19 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:20.194261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:20.195078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:20.202971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:20.203430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:20.204216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:20.204694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:20.293672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:20.302179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6886dc84-f03a-41bb-959a-972e899469a2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.111892 May 31 15:00:20.302793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 577/1164] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:20 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:21.320822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:21.322161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:21.329483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:21.330224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:21.331217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:21.331895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:21.415800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:21.424904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e2138293-a57f-4301-bf6d-9946cbd5efbf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.107854 May 31 15:00:21.425743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 588/1165] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:22.446896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:22.448140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:22.455171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:22.455899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:22.456711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:22.457156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:22.523170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:22.531001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e5e224d0-2266-45f5-86a4-67c82ca033e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087935 May 31 15:00:22.531581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 578/1166] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:23.555300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:23.555878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:23.563152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:23.563615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:23.564413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:23.564865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:23.639713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:23.648735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d1aa211a-ec24-4ac2-88b9-ed2cf3b57673 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.097319 May 31 15:00:23.649398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 589/1167] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:23 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:24.667116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:24.667830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:24.676227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:24.677011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:24.677881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:24.678349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:24.760872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:24.776863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-acfcadf2-0790-47e2-aa64-1bd99a2da0aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.113263 May 31 15:00:24.777836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 579/1168] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:25.465755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:00:25.466058 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:00:25.794444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:25.795308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:25.801952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:25.802404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:25.803295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:25.803738 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:25.872051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:25.880622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6049e6cb-e3ac-44ca-892f-ec6c7e7d624f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090574 May 31 15:00:25.881223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 590/1169] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:25 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:26.507598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:00:26.507883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:00:26.906489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:26.907207 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:26.909894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=42 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:26.917231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:26.917742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:26.918602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:26.919234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:26.922850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:26.994408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:27.002628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-40b0e507-52cc-4439-a2be-11a240859b4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100116 May 31 15:00:27.003249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 580/1170] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:28.020585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:28.021319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:28.029705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:28.030293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:28.031318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:28.031854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:28.049124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:28.108527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:28.116399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-91f259f4-310c-447a-890e-fb12d465ab8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100261 May 31 15:00:28.116992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 591/1171] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:29.137909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:29.139085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:29.151093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:29.151916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:29.153314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:29.154124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:29.245240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:29.253611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8c7abdcb-8f3a-4330-9693-74b379713859 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.123625 May 31 15:00:29.254210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 581/1172] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:29 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:30.271490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:30.272139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:30.274524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=42 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:30.281260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:30.281761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:30.282640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:30.283337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:30.349398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:30.359084 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c68294d5-0d27-4130-9fff-5f10a5cee2cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091351 May 31 15:00:30.359890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 592/1173] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:30 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:31.385655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:31.386263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:31.393229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:31.393749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:31.394564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:31.395096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:31.466782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:31.474609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d21926fb-3862-43c4-bb8d-f083a849a6c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093181 May 31 15:00:31.475272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 582/1174] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:31 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:32.492992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:32.493590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:32.501130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:32.501577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:32.502354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:32.502825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:32.567669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:32.575503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2e8c6faa-8904-4a85-b1ad-9e9f48503b7d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086589 May 31 15:00:32.576094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 593/1175] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:33.599540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:33.600301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:33.607471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:33.607923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:33.608737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:33.609178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:33.679266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:33.687191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-06468639-bb1a-46c7-b0fc-f31e22fac125 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091546 May 31 15:00:33.687770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 583/1176] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:33 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:34.707512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:34.708500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:34.715985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:34.716434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:34.717221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:34.717659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:34.786000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:34.794860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-787feaf0-c6fc-4493-8b77-6afd543739ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092725 May 31 15:00:34.795537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 594/1177] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:35.812430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:35.813144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:35.819941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:35.820457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:35.821378 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:35.822443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:35.902477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:35.910624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f404a164-152c-43eb-8add-f65a1d99a1c9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.102029 May 31 15:00:35.911219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 584/1178] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:36.928750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:36.929436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:36.936850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:36.937308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:36.938101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:36.938547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:37.005712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:37.015421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-15a3cc1c-f83a-4f25-9c39-a77e9e8c1d4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090852 May 31 15:00:37.016250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 595/1179] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:36 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:38.034605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:38.035319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:38.042745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:38.043203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:38.044001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:38.044450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:38.110120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:38.118035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d9efd37b-de5a-4c31-b07a-ef7abb792921 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087785 May 31 15:00:38.118610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 585/1180] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:39.142452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:39.143384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:39.150776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:39.151240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:39.152057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:39.152505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:39.218019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:39.225904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-353a73b0-1535-4351-ad62-463b677efe21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087299 May 31 15:00:39.226492 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 596/1181] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:40.243940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:40.244656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:40.251683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:40.252133 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:40.252928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:40.253367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:40.322400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:40.330863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4e3f50dd-d92e-4908-8c73-26a7dbf2b5f1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090776 May 31 15:00:40.331620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 586/1182] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:40 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:41.357081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:41.357740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:41.364349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:41.364801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:41.365567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:41.366001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:41.428788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:41.436924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-edd56de7-7af8-40e4-83d2-74571b56c01f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083720 May 31 15:00:41.437501 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 597/1183] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:42.454148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:42.454787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:42.462961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:42.463433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:42.464227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:42.464676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:42.536586 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:42.544244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-96c51906-4ff3-4ea3-b452-b4ad3df2d616 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093981 May 31 15:00:42.544844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 587/1184] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:42 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:43.562219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:43.563047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:43.569495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:43.569946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:43.570754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:43.571195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:43.649262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:43.658037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4d788219-61dc-4b45-a502-aadd9df3ca80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099769 May 31 15:00:43.658617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 598/1185] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:44.676008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:44.676631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:44.682965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:44.683416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:44.684186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:44.684625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:44.749064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:44.757819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-35c6553a-f06e-4db0-bc96-9250894ad2a3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085855 May 31 15:00:44.758397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 588/1186] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:44 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:45.775522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:45.776123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:45.782565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:45.783051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:45.783823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:45.784259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:45.848503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:45.857101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9ba92358-60f5-466c-8166-1e59f6388b5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085406 May 31 15:00:45.857674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 599/1187] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:46.873546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:46.874171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:46.880890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:46.881339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:46.882113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:46.882553 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:46.946132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:46.956512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-10c59247-9593-4e1c-95a1-82498cd88230 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086585 May 31 15:00:46.957380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 589/1188] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:46 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:47.974744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:47.975381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:47.982610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:47.983090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:47.983857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:47.984297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:48.051529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:48.059497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b757370-d656-49d3-a059-9c163bb69d46 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088619 May 31 15:00:48.060082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 600/1189] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:49.077024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:49.077654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:49.084993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:49.085454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:49.086251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:49.086714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:49.161845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:49.170616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0d34e12b-c4df-42ce-ae22-60bf5af6b8c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.097510 May 31 15:00:49.171245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 590/1190] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:50.188619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:50.189229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:50.195917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:50.196372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:50.197695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:50.198126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:50.262633 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:50.270345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8f1232ee-dd37-45a7-a5fe-e64fb706a6b9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085686 May 31 15:00:50.270959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 601/1191] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:51.287396 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:51.287993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:51.295243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:51.295701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:51.296490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:51.296931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:51.361049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:51.368908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-de63deee-dbf4-4bd3-8179-44f7e16042c3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085387 May 31 15:00:51.369495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 591/1192] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:52.386020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:52.386597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:52.396240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:52.397036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:52.398427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:52.399253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:52.467861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:52.475781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a2aba5e8-6c98-4595-badb-7a6c03d37c40 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093634 May 31 15:00:52.476365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 602/1193] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:53.498050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:53.498677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:53.505619 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:53.506073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:53.506894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:53.507343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:53.575821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:53.584203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c62657b1-0d98-40a9-acdc-c8294ba8772d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090584 May 31 15:00:53.584776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 592/1194] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:53 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:54.601459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:54.602069 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:54.608848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:54.609297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:54.610065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:54.610505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:54.677794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:54.686136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-10cc2d26-54da-4da1-8960-62e862b30461 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088562 May 31 15:00:54.686734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 603/1195] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:55.706345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:55.707006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:55.714622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:55.715102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:55.715892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:55.716341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:55.782915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:55.795127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fb3087b7-51fa-4515-b677-ab00cf6a30f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092254 May 31 15:00:55.796561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 593/1196] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:56.819810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:56.820450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:56.827165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:56.827610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:56.828373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:56.828805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:56.892878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:56.901123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0751ee6b-abee-44ef-ba3b-a30a49e53a72 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085175 May 31 15:00:56.901691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 604/1197] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:00:57.918089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:57.918769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:57.921099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:57.926820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:57.927328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:57.928113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:57.928556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:57.932308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:58.018084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:58.026284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-57445bd1-050e-4c0b-8515-89aecf3c5c10 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.112065 May 31 15:00:58.026915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 594/1198] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:00:59.048462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:00:59.049402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:00:59.061875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:59.062691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:59.064111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:00:59.064895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:00:59.072369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=82 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:59.153832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:00:59.162794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c06c5a00-7a02-4a96-b374-8acdfaffd0ad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.121854 May 31 15:00:59.163398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 605/1199] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:00:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:00.181846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:00.182461 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:00.189274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:00.189735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:00.190857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:00.191307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:00.252700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:00.260958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bfe4e886-2545-44bd-9670-5c8814d7ad54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083475 May 31 15:01:00.261532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 595/1200] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:01.278566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:01.279381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:01.281556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:01.287146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:01.287602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:01.288383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:01.288821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:01.356845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:01.370609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9bbc89df-eb6a-460a-a33b-d3daa4386d33 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095612 May 31 15:01:01.371314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 606/1201] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:02.388324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:02.389328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:02.397649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:02.398111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:02.398931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:02.399913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:02.480135 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:02.489003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8fdd6e03-7f52-481a-bd66-812082a097a1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.104793 May 31 15:01:02.489660 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 596/1202] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:03.507748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:03.508311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:03.515416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:03.515861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:03.516625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:03.517060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:03.583946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:03.592643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-729a1999-d11b-4be0-abd3-868da65e1523 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088807 May 31 15:01:03.593218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 607/1203] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:04.609840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:04.610452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:04.617250 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:04.617710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:04.619012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:04.619486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:04.682560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:04.690082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-486dfc1b-cebb-4ee3-bb63-28680db80bb2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084140 May 31 15:01:04.690667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 597/1204] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:04 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:05.707576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:05.708189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:05.715485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:05.715935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:05.716704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:05.717146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:05.777843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:05.785552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7b37e85e-70af-45f2-a40a-98958b3ec60f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081976 May 31 15:01:05.786124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 608/1205] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:06.802611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:06.803259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:06.810279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:06.810766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:06.811539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:06.812004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:06.875151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:06.882672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9ef5cd9e-da65-4d50-9c1d-4e874222c947 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083879 May 31 15:01:06.883534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 598/1206] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:07.900530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:07.901144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:07.907725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:07.908207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:07.908972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:07.909412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:07.971658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:07.979209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7b035452-d63e-4b5c-a1ec-083f6e1f675a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083103 May 31 15:01:07.979778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 609/1207] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:08.996252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:08.997633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:09.004244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:09.004704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:09.005489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:09.005927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:09.067517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:09.075112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0022ef30-83f9-45f1-9f8e-1ec74a6737d6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082695 May 31 15:01:09.075681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 599/1208] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:08 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:10.092394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:10.093020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:10.099552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:10.100014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:10.100785 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:10.101333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:10.163664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:10.171175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-de9c544a-5e73-47d6-ad5a-a6bff5f021ae tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082732 May 31 15:01:10.171770 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 610/1209] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:11.188203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:11.188834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:11.195438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:11.195894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:11.196664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:11.197108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:11.268153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:11.276305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c75ca445-83ca-4133-a169-bbab869db5a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091985 May 31 15:01:11.276877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 600/1210] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:12.294283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:12.294970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:12.301677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:12.302127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:12.302917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:12.303354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:12.364148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:12.372598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c7dbdc1f-a9a9-4ce6-a981-014fd32caeb1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082499 May 31 15:01:12.373167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 611/1211] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:13.390096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:13.390680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:13.396712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:13.397170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:13.397941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:13.398387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:13.460241 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:13.467788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a8e77a84-d3c2-46da-b080-b63db8cffe2b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081823 May 31 15:01:13.468352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 601/1212] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:13 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:14.484555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:14.485149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:14.491590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:14.492035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:14.492796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:14.493232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:14.558747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:14.567852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7a59395f-510b-4d03-a5e8-b25910d946d9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087375 May 31 15:01:14.568454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 612/1213] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:14 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:15.585169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:15.585722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:15.592396 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:15.592848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:15.593609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:15.594048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:15.659365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:15.667483 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a619ce7f-a0a2-419a-8d2a-43fb5b4e3a44 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086300 May 31 15:01:15.668198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 602/1214] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:15 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:16.685418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:16.686005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:16.692528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:16.692971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:16.693719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:16.694146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:16.754442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:16.763175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-156b7387-9f19-46a7-a88e-e283c58336d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081631 May 31 15:01:16.763751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 613/1215] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:17.780267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:17.780911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:17.787469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:17.787927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:17.788698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:17.789142 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:17.850196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:17.858283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8e76db5f-88b6-4c4e-ae43-f41c5b4c06c7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081884 May 31 15:01:17.858879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 603/1216] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:18.875903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:18.876527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:18.883667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:18.884130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:18.884905 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:18.885344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:18.946833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:18.954399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3ea0ebd2-bf1d-4d9b-857f-628ad6d9cac2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082441 May 31 15:01:18.955203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 614/1217] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:18 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:19.971847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:19.972509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:19.979833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:19.980292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:19.981087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:19.981529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:20.051720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:20.062181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d7e0f1da-5985-4f9e-9c62-77b055f928a0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093974 May 31 15:01:20.063098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 604/1218] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:19 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:21.079734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:21.080311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:21.087207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:21.087652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:21.088403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:21.088834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:21.152590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:21.160319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fbbaff40-1586-4429-9bb5-1078f64267cb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084513 May 31 15:01:21.160903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 615/1219] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:22.178379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:22.179020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:22.186344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:22.186760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:22.187537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:22.187983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:22.249467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:22.257115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0f652065-6738-414d-ab93-0d66626e43b8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082612 May 31 15:01:22.257685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 605/1220] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:23.273456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:23.274053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:23.280697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:23.281145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:23.281914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:23.282357 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:23.344884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:23.353159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e7a07a11-f8c5-4959-9ea0-69d9b3ed9b8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083577 May 31 15:01:23.353771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 616/1221] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:23 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:24.369303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:24.369945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:24.376433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:24.376881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:24.377642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:24.378082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:24.442599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:24.450754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cd3967e5-8a5b-4749-8056-f83a3946de0e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085266 May 31 15:01:24.451315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 606/1222] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:25.469745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:25.470387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:25.477822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:25.478269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:25.479062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:25.479497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:25.539969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:25.547854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3d68df15-6cc6-4316-90cb-e6d46206fcc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083989 May 31 15:01:25.548433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 617/1223] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:25 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:26.565159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:26.565728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:26.572582 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:26.573027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:26.573802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:26.574243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:26.636323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:26.644021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3097a6a0-eb39-4d7b-8198-69e6cf7957b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082900 May 31 15:01:26.644588 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 607/1224] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:27.661415 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:27.662030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:27.668638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:27.669092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:27.669864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:27.670301 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:27.731264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:27.738585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-979c3eaf-1cd4-4120-af28-903d4a00d28e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081206 May 31 15:01:27.739174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 618/1225] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:27 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:28.756082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:28.756717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:28.759986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:28.765548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:28.766004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:28.766808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:28.767253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:28.770075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:28.832933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:28.841310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2c188885-da83-4c1a-8687-a838a8156b8b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089185 May 31 15:01:28.841923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 608/1226] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:29.858739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:29.859360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:29.866143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:29.866595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:29.867398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:29.867834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:29.870817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=84 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:29.936772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:29.944442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a928a985-e0be-450c-834a-7913f88adfd6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089703 May 31 15:01:29.945028 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 619/1227] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:29 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:30.962552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:30.963213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:30.969704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:30.970187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:30.970992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:30.971439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:31.032958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:31.041006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ea877fb7-4f7b-4b75-94d0-e625257aff41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082342 May 31 15:01:31.041566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 609/1228] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:30 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:01:32.058056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:32.058688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:32.060988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:32.066798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:32.067252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:32.068026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:32.068465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:32.129528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:32.137856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3f3616d2-e852-48d8-b4e5-792280ccbc36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083618 May 31 15:01:32.138418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 620/1229] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:33.155079 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:33.155698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:33.162151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:33.162601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:33.163408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:33.164501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:33.228494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:33.236111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-76336a78-c6b0-4f9e-b637-b164093eabc1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084850 May 31 15:01:33.236673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 610/1230] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:33 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:34.253026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:34.253647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:34.260781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:34.261237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:34.262004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:34.262443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:34.322982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:34.330466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-69106a68-9cd1-49d5-a4d0-724983d7b2af tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081434 May 31 15:01:34.331070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 621/1231] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:35.347809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:35.348467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:35.356112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:35.356570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:35.357366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:35.357816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:35.427397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:35.435404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a3504ea3-31d0-4173-b3c3-84a26df01102 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091455 May 31 15:01:35.436006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 611/1232] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:36.452580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:36.453228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:36.459844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:36.460283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:36.461686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:36.462119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:36.521622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:36.529707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5ee192b-eee3-4ce3-a1b8-9d6eeb30ac1d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081034 May 31 15:01:36.530295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 622/1233] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:36 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:37.547426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:37.547972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:37.554575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:37.555059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:37.555827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:37.556265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:37.620020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:37.627812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f2b5af33-039c-4642-8752-cf11ef875ddc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084741 May 31 15:01:37.628389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 612/1234] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:37 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:38.644745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:38.645354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:38.652003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:38.652450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:38.653208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:38.653643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:38.716688 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:38.724266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-afbb6f21-17ed-4a75-9b04-f41664766ee5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083368 May 31 15:01:38.724837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 623/1235] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:39.740782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:39.741335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:39.747807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:39.748255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:39.749021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:39.749455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:39.810119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:39.817630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2b3c7607-72dd-4182-8243-93e4b31f2237 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080899 May 31 15:01:39.818190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 613/1236] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:40.834890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:40.836175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:40.842859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:40.843313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:40.844084 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:40.844522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:40.907136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:40.915642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2e42da53-2ff3-4fb6-aab1-49938570bbcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084733 May 31 15:01:40.916223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 624/1237] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:40 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:41.932615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:41.933251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:41.939762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:41.940216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:41.940965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:41.941397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:42.004527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:42.012509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b8a284c5-0950-48ae-8b82-2be8e891e653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083719 May 31 15:01:42.013099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 614/1238] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:43.030288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:43.030995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:43.037552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:43.038004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:43.039452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:43.039889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:43.101193 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:43.108683 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-89ada90f-0d84-4526-88e0-258d1d1d0329 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082308 May 31 15:01:43.109257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 625/1239] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:44.126421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:44.127279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:44.134957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:44.135411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:44.136188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:44.136627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:44.201544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:44.209521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-436cfc20-fb03-4c0b-9ea3-9c149182f8d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087518 May 31 15:01:44.210112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 615/1240] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:44 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:45.228025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:45.228662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:45.234807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:45.235257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:45.236019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:45.236456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:45.299595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:45.307376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff5ed626-3ea5-4886-bab8-6fe0d97f4cea tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084015 May 31 15:01:45.307947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 626/1241] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:46.324195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:46.324838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:46.331495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:46.331949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:46.332718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:46.333159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:46.397265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:46.405661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37fa7940-0a77-4de8-8d0b-5b9ef4de2b6f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085355 May 31 15:01:46.406238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 616/1242] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:46 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:47.423396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:47.423949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:47.430996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:47.431458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:47.432218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:47.432656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:47.493014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:47.500615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-06193d95-5561-45b2-be70-01278e775a55 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081432 May 31 15:01:47.501189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 627/1243] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:48.518196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:48.518775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:48.525983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:48.526439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:48.527237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:48.527674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:48.587484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:48.594909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-869f8fb1-d13a-48e6-b9a4-9b154dbad42f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080669 May 31 15:01:48.595474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 617/1244] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:49.612252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:49.612857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:49.619438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:49.619881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:49.620627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:49.621057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:49.689748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:49.697428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-669e8762-28bc-48f2-9ff0-4dd79f97c53f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089035 May 31 15:01:49.697994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 628/1245] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:50.714609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:50.715213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:50.721997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:50.722454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:50.723264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:50.723707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:50.795408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:50.803916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3f64072-2eba-479a-9759-8d31db75451f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093222 May 31 15:01:50.804990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 618/1246] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:51.822021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:51.822667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:51.829283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:51.829737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:51.830562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:51.831032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:51.894333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:51.902542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-528b153a-52c1-41f6-8af6-084a18b3b9ba tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084939 May 31 15:01:51.903163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 629/1247] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:52.919792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:52.922374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:52.929102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:52.929556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:52.930323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:52.930792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:52.992409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:53.000115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e3d0de92-077c-4e0f-8c21-b40394afeefe tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084515 May 31 15:01:53.000693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 619/1248] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:54.017584 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:54.018182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:54.025953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:54.026639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:54.027563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:54.028019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:54.093598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:54.102233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ea76e0c5-2975-4db5-89a8-7d9a6c9f5b91 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088526 May 31 15:01:54.102992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 630/1249] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:55.119786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:55.120407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:55.127145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:55.127599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:55.128414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:55.128855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:55.203244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:55.211980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3892ad71-4276-4019-ace3-2b08445aeb69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.096131 May 31 15:01:55.212559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 620/1250] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:56.228848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:56.229491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:56.236461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:56.236911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:56.237679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:56.238124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:56.301799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:56.310154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-64a68b17-6db7-4bc9-b861-0a39d00a81f0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085144 May 31 15:01:56.310761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 631/1251] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:57.327887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:57.328580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:57.335899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:57.336361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:57.337141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:57.337584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:57.400358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:57.408446 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-47eb0579-ed43-4033-aabe-ac52a93796bd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084496 May 31 15:01:57.409035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 621/1252] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:58.096344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:01:58.096639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:01:58.293087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:01:58.293668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:01:58.425837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:58.426466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:58.433434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:58.433885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:58.434863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:58.435306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:58.501795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:58.509715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-71f7a1b6-fa84-4a93-b10b-94f32f623f80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088068 May 31 15:01:58.510311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 632/1253] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:58 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:01:59.527529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:01:59.528310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:01:59.531016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:59.536931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:59.537381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:59.538689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:01:59.539191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:01:59.542052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:59.616773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:01:59.625245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-675a6cfd-84e4-42d2-a76c-e8840b96cb17 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101702 May 31 15:01:59.625900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 622/1254] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:01:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:00.643834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:00.644451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:00.652365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:00.652812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:00.653592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:00.654115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:00.657142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=84 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:00.731057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:00.740565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-511f43d7-4415-4288-a879-a3c84b124c38 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101001 May 31 15:02:00.741850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 633/1255] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:01.764859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:01.765451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:01.772698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:01.773147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:01.773908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:01.774343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:01.840445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:01.848471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b9357936-233e-4a2f-bd85-ada9f48fde9c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087348 May 31 15:02:01.849069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 623/1256] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:02.865129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:02.865728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:02.868719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:02.874028 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:02.874482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:02.875287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:02.875727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:02.937541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:02.945187 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2a64ecab-fea9-46a6-8f39-b66a89e5bd7b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083943 May 31 15:02:02.945816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 634/1257] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:03.962849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:03.963493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:03.970112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:03.970569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:03.971363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:03.971805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:04.037152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:04.045152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-352ef439-a6c4-45bc-af2e-4c7f3e10f37d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086971 May 31 15:02:04.045706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 624/1258] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:05.061852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:05.062496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:05.069412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:05.069864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:05.070682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:05.071104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:05.133801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:05.141405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fe44a8a4-614e-40a8-9651-addad5b01e4d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083474 May 31 15:02:05.141967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 635/1259] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:06.158917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:06.159522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:06.167198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:06.167645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:06.168408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:06.168841 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:06.231438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:06.238917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-23e433e5-18dc-427d-9a96-9599df2e8819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083846 May 31 15:02:06.239481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 625/1260] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:07.255616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:07.256152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:07.262761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:07.263220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:07.263987 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:07.264429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:07.325048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:07.332465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7971e813-dc17-4c71-88ec-e1162dc00bca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080848 May 31 15:02:07.333034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 636/1261] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:08.350033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:08.350674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:08.357227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:08.357685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:08.358455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:08.358924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:08.422956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:08.431063 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bb779ced-22bf-4af0-98a9-d0deb69590b0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084886 May 31 15:02:08.431633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 626/1262] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:08 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:02:09.448019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:09.448609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:09.455262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:09.455706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:09.456457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:09.456897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:09.517474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:09.525009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c04be065-0854-46e3-ad2b-2b7af320aa18 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081013 May 31 15:02:09.525580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 637/1263] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:09 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:10.541916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:10.542472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:10.549337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:10.549788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:10.550551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:10.551017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:10.611747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:10.619796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f9733336-409c-4339-b8b6-c54775fcd6b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081863 May 31 15:02:10.620367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 627/1264] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:11.637143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:11.637742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:11.644289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:11.644742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:11.645479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:11.645915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:11.706201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:11.714403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d36c9434-eae7-4e39-bab6-5bcd8501d9df tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081111 May 31 15:02:11.715006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 638/1265] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:12.732234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:12.732765 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:12.739325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:12.739776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:12.740544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:12.740988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:12.805237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:12.812784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-da045806-0896-42ee-a9d1-4744e33fd7b4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084571 May 31 15:02:12.813336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 628/1266] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:13.829867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:13.830571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:13.838186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:13.838636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:13.839520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:13.839959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:13.903532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:13.910922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d4052bb6-9216-4911-8df3-fe237c19334c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085057 May 31 15:02:13.911494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 639/1267] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:13 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:14.928818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:14.929459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:14.935531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:14.935990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:14.936766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:14.937210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:14.999234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:15.006947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fe9983ac-d4fe-426b-b292-b5a85d19cd00 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082750 May 31 15:02:15.007521 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 629/1268] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:14 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:15.477572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:15.478110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:15.484131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:15.484585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:15.485415 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:15.485801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:15.500029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf HTTP/1.1 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Openstack-Nova-Api-Version: 2.20 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:02:15.501739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.503621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'fa32ede9-a62b-454c-9f59-6ffb472798cf'} May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:02:15.505212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.506999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:02:15.508626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:02:15.510768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fd83c46b-efa9-4d85-ae59-444b5b5cab85 tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 404 len: 111 microversion: 2.20 time: 0.030261 May 31 15:02:15.511374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 640/1269] 10.222.0.67 () {60 vars in 1279 bytes} [Tue May 31 15:02:15 2022] DELETE /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 15:02:15.519227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:15.519839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] [instance: fa32ede9-a62b-454c-9f59-6ffb472798cf] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:15.525711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:15.526169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:15.526956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:15.527394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:15.541844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] HTTP exception thrown: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Request method failure captured: May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf HTTP/1.1 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilijR5U5H5ADm5VRUNk-OnCnokIAXE_YkR2-yQInhx-akvmd-eOsXT4BuMdGJOWfq0ok43lSmI4YGiNRDM0zB_ijXLSSfHGYCkGIIDjLLzw9IqNsSVTCuUa9-1AoAx9cW3e8QRqBTq2jBpfODOTqF8_lzRJNr_VyMQE_n9VlPD9oNcrM May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Openstack-Nova-Api-Version: 2.20 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 502541429884445e8426837b3fd0d75e May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:02:15.543700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/502541429884445e8426837b3fd0d75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/502541429884445e8426837b3fd0d75e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_502541429884445e8426837b3fd0d75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 502541429884445e8426837b3fd0d75e May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516535816 May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 32e6ace174a840f78c8d570719c3f631 May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516535816-project May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.545454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'fa32ede9-a62b-454c-9f59-6ffb472798cf'} May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:02:15.546903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. May 31 15:02:15.548579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:02:15.550101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] Returning 404 to user: Instance fa32ede9-a62b-454c-9f59-6ffb472798cf could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:02:15.550101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6f4113f4-875e-4a04-87a0-7f451b627b6f tempest-AttachVolumeShelveTestJSON-516535816 tempest-AttachVolumeShelveTestJSON-516535816-project] 10.222.0.67 "GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf" status: 404 len: 111 microversion: 2.20 time: 0.029714 May 31 15:02:15.550101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 630/1270] 10.222.0.67 () {60 vars in 1276 bytes} [Tue May 31 15:02:15 2022] GET /compute/v2.1/servers/fa32ede9-a62b-454c-9f59-6ffb472798cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 15:02:16.023671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:16.024294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:16.030525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:16.031376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:16.032376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:16.033026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:16.099416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:16.107713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5f92ec7c-9369-46cd-80dd-dd1603da5d43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087984 May 31 15:02:16.108385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 641/1271] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:17.132086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:17.133940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:17.141563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:17.142560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:17.143386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:17.144350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:17.212959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:17.220737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c2ea9ddb-df27-4cb6-8b84-52a24f368ede tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.097616 May 31 15:02:17.221646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 631/1272] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:18.237342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:18.237882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:18.245041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:18.245488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:18.246269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:18.246720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:18.316859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:18.329079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5cc0b925-d542-448f-9161-e37e0f36c5f8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095401 May 31 15:02:18.330247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 642/1273] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:18 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:19.346907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:19.347630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:19.354596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:19.355179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:19.356709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:19.357162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:19.428949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:19.440869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1ba99e41-c74c-472b-8747-5149918971a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.098174 May 31 15:02:19.441848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 632/1274] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:19 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:20.666828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:20.668625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:20.675178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:20.675634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:20.676421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:20.676840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:20.756208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:20.767874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2f6a81ca-b86c-4e92-bd09-5b5805bd4455 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.312390 May 31 15:02:20.770702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 643/1275] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:20 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:21.784256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:21.784879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:21.792002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:21.792788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:21.793795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:21.794477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:21.872670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:21.882930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6299607c-419a-4f53-891e-cca38191a1e2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.102520 May 31 15:02:21.892273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 633/1276] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:22.663724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:02:22.664034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:02:22.900610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:22.901893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:22.909239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:22.910009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:22.911049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:22.911689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:23.002713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:23.022986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-52c54924-bc32-41cb-9344-188e6ccc9819 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.126685 May 31 15:02:23.024283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 644/1277] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:24.034932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b6834462-4c58-4b94-88f1-1ed983c7b7e1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: .version_select at 0x7f8dc8934940>, body: {"keypair": {"name": "tempest-keypair-1459060482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtVBrdchN/kSE51yVvXqkXpCSIFeia5a819dcKBFkpVvylCVY62DLbr4sjqebsOVHBaPDCwsGCVS7tI74e6L1ybPAV3+e14GKKzpUPvqHpJ4bxGcatufTJe7meVeP83hA=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:02:24.039963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:24.040581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:24.047399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:24.047852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:24.048623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:24.049243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:24.052418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-b6834462-4c58-4b94-88f1-1ed983c7b7e1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:02:24.058295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-b6834462-4c58-4b94-88f1-1ed983c7b7e1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:02:24.090603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b6834462-4c58-4b94-88f1-1ed983c7b7e1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112536 May 31 15:02:24.091932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 634/1278] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 15:02:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:02:24.123186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:24.136755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8a641744-294f-4d5b-8122-fb100f892926 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100411 May 31 15:02:24.137470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 645/1279] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:02:25.153628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:25.154900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:25.162910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:25.163368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:25.164141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:25.164759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:25.230344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:25.240900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-553ba15a-39d0-4bcc-83bd-873410acd0b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090524 May 31 15:02:25.241634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 635/1280] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:25 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:25.758095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391703749", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5750f2c5-2b61-4d8b-8c4e-2d47f35308a2"}], "security_groups": [{"name": "tempest-securitygroup--357863866"}], "key_name": "tempest-keypair-1459060482", "user_data": "}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:02:25.861437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] validate_networks() for [('5750f2c5-2b61-4d8b-8c4e-2d47f35308a2', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:02:26.262023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:26.262516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:26.270997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:26.271773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:26.272759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:26.273443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:26.316173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:02:26.316965 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:02:26.317739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:02:26.318429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:02:26.319537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:02:26.331447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:26.332354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:26.347516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:26.352543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:26.357478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:26.367125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f7f20429-42d0-48a4-9fa3-81b8edca4c8a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.112016 May 31 15:02:26.368534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 636/1281] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:26.387946 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:02:26.392601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:02:26.404228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:02:26.406758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:02:26.461561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-aaafef3a-af0b-44f9-9bb3-fe71eb9bd1b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.707693 May 31 15:02:26.462895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 646/1282] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:02:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:02:26.473046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-89772b50-6579-45ee-837e-51a85a9339ac tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:26.474028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-89772b50-6579-45ee-837e-51a85a9339ac tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:26.552456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-89772b50-6579-45ee-837e-51a85a9339ac tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:26.560411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-89772b50-6579-45ee-837e-51a85a9339ac tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1241 microversion: 2.1 time: 0.091437 May 31 15:02:26.562386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 637/1283] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:26 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:27.385560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:27.386100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:27.395994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:27.397009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:27.397807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:27.398246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:27.473530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:27.482492 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ec3a22ab-3c93-4537-bda2-85f2f0bb527d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101718 May 31 15:02:27.492259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 647/1284] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:27 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:27.580845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:27.581459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:27.596013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:27.596464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:27.597453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:27.598059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:27.689442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:27.698166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab09a993-f928-4a6a-8eca-3054c9296bdc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1293 microversion: 2.1 time: 0.122803 May 31 15:02:27.701988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 638/1285] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:27 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:28.499541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:28.500170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:28.507743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:28.508199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:28.508982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:28.509423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:28.590569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:28.602533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2981ad01-3730-4c8b-975b-fb13d09a42dd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.106794 May 31 15:02:28.613104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 648/1286] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:28.717551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:28.718135 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:28.726242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:28.726717 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:28.727886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:28.728272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:28.862526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:28.870080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bb4f7fa7-9c96-4a07-a346-f1f81eb87980 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.156614 May 31 15:02:28.878211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 639/1287] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:28 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:29.198890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-4b8f888a-c04b-48b2-bbba-7bee1d60f1e4 req-82c44db7-c2a7-4163-acee-5c46c3f340f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3f067e-4a88-4f16-aca3-284ecab21200", "tag": "318ba0f3-9cd9-4159-93a6-841c62d831b6"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:02:29.219829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-4b8f888a-c04b-48b2-bbba-7bee1d60f1e4 req-82c44db7-c2a7-4163-acee-5c46c3f340f0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:29.220194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-4b8f888a-c04b-48b2-bbba-7bee1d60f1e4 req-82c44db7-c2a7-4163-acee-5c46c3f340f0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:29.235349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-4b8f888a-c04b-48b2-bbba-7bee1d60f1e4 req-82c44db7-c2a7-4163-acee-5c46c3f340f0 service nova] Creating event network-changed:318ba0f3-9cd9-4159-93a6-841c62d831b6 for instance 3d3f067e-4a88-4f16-aca3-284ecab21200 on hv-cinder-83979 May 31 15:02:29.240993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-4b8f888a-c04b-48b2-bbba-7bee1d60f1e4 req-82c44db7-c2a7-4163-acee-5c46c3f340f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051573 May 31 15:02:29.241629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 649/1288] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:02:29.620492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:29.621134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:29.623083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:29.628703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:29.629291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:29.630087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:29.630576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:29.647785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=92 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:29.697073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:29.704653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0bcc2705-f22b-48ce-8298-e33fd1b63e87 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088019 May 31 15:02:29.705218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 640/1289] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:29 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:29.888226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:29.888848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:29.895415 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:29.895868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:29.897130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:29.897568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:30.028092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:30.035548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c694d6b5-2195-41b7-acc8-dfd20b2197e8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.152183 May 31 15:02:30.036118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 650/1290] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:29 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:30.722860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:30.723497 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:30.730705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:30.731153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:30.731910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:30.732344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:30.793705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:30.801639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-03764ef7-7ff9-4aba-ad25-0e1cba455b21 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082974 May 31 15:02:30.802481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 641/1291] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:30 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:31.053143 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:31.053820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:31.061352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:31.061806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:31.062591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:31.063052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:31.065756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=96 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:31.198805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:31.206676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e759a2fa-5366-410b-a6f0-1de6fc566a1f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.157581 May 31 15:02:31.207262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 651/1292] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:31 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:31.819671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:31.820299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:31.827836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:31.828295 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:31.829080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:31.829523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:31.895779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:31.903768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-be447aba-a469-441c-9ae8-927951311afb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089077 May 31 15:02:31.904607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 642/1293] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:31 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:32.227703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:32.227703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:32.234018 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:32.234464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:32.235329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:32.235760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:32.368789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:32.376329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-71bdcd9f-6aa5-4eb9-9990-809d087ff3e3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.154081 May 31 15:02:32.376898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 652/1294] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:32 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:32.921450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:32.922784 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:32.929892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:32.930353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:32.931565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:32.931718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:32.998007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:33.006559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6e09accf-3c63-4f30-87a7-cb2d5c1c1c4c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088384 May 31 15:02:33.007350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 643/1295] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:33.393388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:33.394117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:33.396728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:33.402060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:33.402533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:33.403329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:33.403769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:33.538501 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:33.545755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b1636e0-d2ef-4e69-9285-94b31e6f44a3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.156315 May 31 15:02:33.546591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 653/1296] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:33 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:34.024373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:34.024994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:34.031793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:34.032251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:34.033061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:34.033505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:34.095343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:34.102908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-45f7ceec-7e70-4ca7-8dae-872480352bee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082848 May 31 15:02:34.103472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 644/1297] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:34.563832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:34.564460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:34.571630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:34.572083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:34.572844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:34.573285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:34.700884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:34.708256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-27aeb520-ceb1-46e7-906c-8b7e320475a5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.148309 May 31 15:02:34.708820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 654/1298] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:34 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:34.993680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-efc8cb7a-149f-47ef-b027-3f6f72ab4ec0 req-db49a1f3-79e7-40e2-9ece-1ec2661f895a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3f067e-4a88-4f16-aca3-284ecab21200", "name": "network-vif-plugged", "status": "completed", "tag": "318ba0f3-9cd9-4159-93a6-841c62d831b6"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:02:35.001811 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-efc8cb7a-149f-47ef-b027-3f6f72ab4ec0 req-db49a1f3-79e7-40e2-9ece-1ec2661f895a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:35.002269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-efc8cb7a-149f-47ef-b027-3f6f72ab4ec0 req-db49a1f3-79e7-40e2-9ece-1ec2661f895a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:35.013781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-efc8cb7a-149f-47ef-b027-3f6f72ab4ec0 req-db49a1f3-79e7-40e2-9ece-1ec2661f895a service nova] Creating event network-vif-plugged:318ba0f3-9cd9-4159-93a6-841c62d831b6 for instance 3d3f067e-4a88-4f16-aca3-284ecab21200 on hv-cinder-83979 May 31 15:02:35.019815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-efc8cb7a-149f-47ef-b027-3f6f72ab4ec0 req-db49a1f3-79e7-40e2-9ece-1ec2661f895a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087098 May 31 15:02:35.020439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 645/1299] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:02:35.120670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:35.121293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:35.127753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:35.128213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:35.129011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:35.129454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:35.193447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:35.201360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1969ebc6-d711-49c6-8bf0-ea2f4d3ad441 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084567 May 31 15:02:35.201991 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 655/1300] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:35.726094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:35.726830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:35.733084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:35.733537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:35.734299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:35.734778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:35.862094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:35.869590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ec2b91f9-9094-49da-a74d-b9e9eb40af0b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1366 microversion: 2.1 time: 0.148229 May 31 15:02:35.870164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 646/1301] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:35 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:36.218015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:36.218660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:36.226399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:36.226904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:36.227701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:36.228166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:36.294708 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:36.302790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d2e2d8f5-96f0-4293-9ab3-d915b851d38b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088559 May 31 15:02:36.303386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 656/1302] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:36 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:36.887387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:36.888143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:36.890267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:36.896226 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:36.896782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:36.897614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:36.898221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:37.033592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:37.041837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2d8a25ea-24db-4c6b-9c28-2c1b448fde61 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1557 microversion: 2.1 time: 0.158557 May 31 15:02:37.042409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 647/1303] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:36 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:02:37.059111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:37.059601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:37.061409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:37.062059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:37.067935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:37.068381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:37.069157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:37.077225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:37.147681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cd26b926-dc11-4f75-b7bf-aef5854eed29 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092353 May 31 15:02:37.148284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 657/1304] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 15:02:37 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:02:37.320442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:37.321175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:37.327364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:37.327891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:37.328674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:37.329119 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:37.416949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:37.425132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7a1928c0-088a-4670-b358-a1b6da43ba80 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.109042 May 31 15:02:37.425714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 648/1305] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:37 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:38.348755 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-500d68ae-4786-4f9f-a4c5-44680a16e899 req-a1327273-3efe-43d8-95d3-712e54f6c62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3f067e-4a88-4f16-aca3-284ecab21200", "tag": "318ba0f3-9cd9-4159-93a6-841c62d831b6"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:02:38.357830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-500d68ae-4786-4f9f-a4c5-44680a16e899 req-a1327273-3efe-43d8-95d3-712e54f6c62e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:38.358363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-500d68ae-4786-4f9f-a4c5-44680a16e899 req-a1327273-3efe-43d8-95d3-712e54f6c62e service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:38.369620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-500d68ae-4786-4f9f-a4c5-44680a16e899 req-a1327273-3efe-43d8-95d3-712e54f6c62e service nova] Creating event network-changed:318ba0f3-9cd9-4159-93a6-841c62d831b6 for instance 3d3f067e-4a88-4f16-aca3-284ecab21200 on hv-cinder-83979 May 31 15:02:38.375502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-500d68ae-4786-4f9f-a4c5-44680a16e899 req-a1327273-3efe-43d8-95d3-712e54f6c62e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088330 May 31 15:02:38.376619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 658/1306] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:02:38.441640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:38.442199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:38.449488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:38.449947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:38.450747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:38.451186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:38.522745 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:38.531984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5bcb36c4-87ee-4f62-b0ea-d66f7e589e39 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094284 May 31 15:02:38.532581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 649/1307] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:39.554154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:39.554927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:39.562222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:39.562712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:39.563944 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:39.564399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:39.634802 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:39.643491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fdb6a58d-ff63-41ba-9230-de72e13608c6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095446 May 31 15:02:39.644101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 659/1308] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:40.660455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:40.661086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:40.667656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:40.668111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:40.668882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:40.669323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:40.732930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:40.740914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-155cf459-b172-4d08-b3ec-739145c280f2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084401 May 31 15:02:40.741491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 650/1309] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:40 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:41.758054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:41.758614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:41.765687 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:41.766135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:41.766952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:41.767395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:41.832083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:41.839616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-27c74d0f-2a20-44c4-bd50-43267dee2dbd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085559 May 31 15:02:41.840186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 660/1310] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:42.856270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:42.856878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:42.863407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:42.863852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:42.864603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:42.865038 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:42.925733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:42.933453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-72d08755-33e0-434a-8716-d11276f40ef0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081038 May 31 15:02:42.934015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 651/1311] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:42 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:43.949502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:43.950197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:43.956922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:43.957386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:43.958151 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:43.958593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:44.023431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:44.031348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fefe8820-fb31-4034-bb28-702ce35a0022 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085698 May 31 15:02:44.031934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 661/1312] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:45.048994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:45.049605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:45.056305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:45.056739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:45.057494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:45.057932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:45.119509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:45.127061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-78059c91-4b98-4478-8935-79d817f1e077 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082114 May 31 15:02:45.127622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 652/1313] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:46.145447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:46.146680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:46.152717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:46.153165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:46.153919 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:46.154669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:46.216519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:46.224545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-08e61d50-d3ae-43c6-a5d7-c6220d6edf59 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082716 May 31 15:02:46.224787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 662/1314] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:46 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:47.241258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:47.241880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:47.249243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:47.249714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:47.250529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:47.251054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:47.320332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:47.329877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3b1b840e-52c0-417e-b234-1a2460e13f28 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092507 May 31 15:02:47.330579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 653/1315] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:48.348327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:48.349659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:48.356416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:48.356914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:48.357726 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:48.358206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:48.436918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:48.445437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-34da3819-a9b5-4133-9575-e9a83a915b66 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100960 May 31 15:02:48.446139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 663/1316] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:49.463651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:49.464650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:49.472560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:49.473209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:49.475007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:49.475492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:49.550776 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:49.559459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8e8e861c-d78e-4e53-8c22-1a3098bf4238 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099918 May 31 15:02:49.560275 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 654/1317] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:50.577190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:50.578081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:50.584956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:50.585546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:50.586365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:50.586883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:50.660728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:50.673092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-70e4734d-da77-424d-8c43-b94257d68192 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099758 May 31 15:02:50.674013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 664/1318] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:51.700931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:51.701679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:51.709594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:51.710180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:51.711120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:51.711682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:51.788638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:51.796883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-53ccd5ae-66a0-4430-8b5e-6711ae8ab649 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.100633 May 31 15:02:51.797484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 655/1319] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:02:52.814672 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:52.815328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:52.823020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:52.823469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:52.824340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:52.824814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:52.891756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:52.900381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-83638944-1fc7-4a18-a679-3483fadf84d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089736 May 31 15:02:52.901348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 665/1320] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:53.919685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:53.920645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:53.928773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:53.929259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:53.930224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:53.930966 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:54.009785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:54.018121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d66a4c08-7f4e-435c-9df7-faf7f18f161c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.103672 May 31 15:02:54.018769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 656/1321] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:53 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:55.037452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:55.038256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:55.046000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:55.046496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:55.047457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:55.047980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:55.126290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:55.135617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0a7a0581-fc3b-4d75-a984-60264f5e5f5c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.103199 May 31 15:02:55.136240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 666/1322] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:56.155334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:56.155955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:56.163778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:56.164237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:56.165029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:56.165473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:56.182496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:56.233562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:56.246828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0eaaf86c-49ab-43d9-bf2b-401f49fe0c2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095343 May 31 15:02:56.247894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 657/1323] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:02:57.266693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:57.267899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:57.275262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:57.275711 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:57.276491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:57.276935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:57.343368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:57.351949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5790aba8-d200-43f6-b822-59e8692b1ea9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090257 May 31 15:02:57.352545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 667/1324] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:58.372121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:58.373265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:58.385040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:58.386683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:58.388103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:58.388900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:58.473772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:58.487545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-19b0d56a-fbc5-4938-99a1-99b3304bbc43 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.121416 May 31 15:02:58.488644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 658/1325] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:58 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:02:59.507290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:02:59.508014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:02:59.515798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:59.516309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:59.517131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:02:59.517741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:02:59.594106 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:02:59.597659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:59.604879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a1d1d54f-bd3d-443a-b7df-7cc4797546ca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101440 May 31 15:02:59.605515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 668/1326] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:02:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:00.622423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:00.623081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:00.625880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=38 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:00.634687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:00.635488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:00.636833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:00.637603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:00.706770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:00.715362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f95b6dfb-716f-4d7f-a24a-576f26e63b8d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.096764 May 31 15:03:00.715971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 659/1327] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:01.733925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:01.734565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:01.741725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:01.742192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:01.743021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:01.743454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:01.811343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:01.822123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cff6f13b-c663-4e4c-9c89-cf68e7e999bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092638 May 31 15:03:01.822758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 669/1328] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:02.840543 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:02.841168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:02.848630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:02.849075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:02.849843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:02.850278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:02.943993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:02.952052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2435bb9d-de48-4d51-87cf-d846cad6d55d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.115629 May 31 15:03:02.952639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 660/1329] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:03.969070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:03.969743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:03.972084 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=34 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:03.977910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:03.978364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:03.979191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:03.979618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:04.046148 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:04.054539 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e5262bf8-024d-4646-b0be-5be86a22652d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089238 May 31 15:03:04.055152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 670/1330] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:05.072215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:05.072836 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:05.080247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:05.080875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:05.081750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:05.082370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:05.153050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:05.160956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-853c99c6-ea47-4ccc-86b8-84a60cdd2306 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092414 May 31 15:03:05.161538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 661/1331] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:06.183358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:06.184247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:06.192110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:06.192565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:06.193341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:06.193778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:06.262558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:06.270763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7200543a-dd66-4fbf-8b5e-e709812167ef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091882 May 31 15:03:06.271346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 671/1332] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:07.294160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:07.294829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:07.302176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:07.302685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:07.303531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:07.304004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:07.389172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:07.397625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4199552b-041a-4354-8cf4-cba9c9355bcf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.111874 May 31 15:03:07.398212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 662/1333] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:08.415132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:08.415732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:08.423105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:08.423556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:08.424327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:08.424762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:08.506194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:08.516513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eb575cf0-63e3-44df-a402-72b5e33cbaef tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.105700 May 31 15:03:08.517515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 672/1334] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:08 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:09.535236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:09.535864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:09.543389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:09.543842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:09.544629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:09.545072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:09.614763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:09.621082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-78275f9c-8ea4-4b15-9583-f426a38dd466 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090174 May 31 15:03:09.621792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 663/1335] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:09 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:10.639549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:10.640163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:10.649646 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:10.650097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:10.650913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:10.651348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:10.719442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:10.729017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d032c304-8f32-4043-a816-4a1d54d64209 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093363 May 31 15:03:10.729619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 673/1336] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:11.747112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:11.747855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:11.755627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:11.756129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:11.756909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:11.757344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:11.831391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:11.840554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-240bc27a-61b1-47f2-b922-6a89fb4a01ab tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.097720 May 31 15:03:11.841134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 664/1337] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:12.861503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:12.862616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:12.874324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:12.875138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:12.876486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:12.877266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:12.950437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:12.958774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a4ddada3-bb85-462f-b9c8-01d1bbb4ac2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.103606 May 31 15:03:12.959566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 674/1338] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:13.976886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:13.978555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:13.985399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:13.985868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:13.986699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:13.987160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:14.051787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:14.060362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-13d042ed-4fd2-438a-83ea-eb6df16229a9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087491 May 31 15:03:14.060978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 665/1339] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:13 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:15.078420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:15.079138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:15.085628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:15.086082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:15.086907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:15.087343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:15.148464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:15.155924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e4cbfb8e-2f06-4329-8d97-3f10608d937f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081568 May 31 15:03:15.156487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 675/1340] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:15 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:16.173663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:16.174280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:16.180910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:16.181366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:16.182140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:16.182588 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:16.247859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:16.256515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4338fa92-fe53-4bd8-b969-0ac0a2dff278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087021 May 31 15:03:16.257081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 666/1341] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:17.273564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:17.274142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:17.280603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:17.281049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:17.281800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:17.282232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:17.342920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:17.350920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-de9958bb-8502-4d73-8793-748e87caf871 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081330 May 31 15:03:17.351831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 676/1342] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:18.368072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:18.368659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:18.375129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:18.375574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:18.376330 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:18.376765 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:18.437293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:18.445199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-19dd74fe-63eb-46fa-954b-68ed30c4ddb6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081183 May 31 15:03:18.445756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 667/1343] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:18 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:19.464904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:19.465576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:19.472188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:19.472643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:19.474025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:19.474506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:19.537168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:19.545017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ce9addc5-7499-452b-98d0-2f599af60b2c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085913 May 31 15:03:19.545848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 677/1344] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:19 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:20.561845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:20.562402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:20.569462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:20.569912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:20.570703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:20.571145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:20.638714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:20.652389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bc1642c9-bf61-4ea8-9db3-48d9fc157416 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094114 May 31 15:03:20.653407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 668/1345] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:20 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:21.677543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:21.678161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:21.684854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:21.685311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:21.686079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:21.686522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:21.748105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:21.756561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9b80ddd9-62a8-4ffb-a81a-ad723d712a90 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083313 May 31 15:03:21.757136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 678/1346] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:22.774303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:22.774974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:22.781625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:22.782073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:22.782871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:22.783313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:22.845090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:22.852591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-222756a8-bc76-44a4-ac96-c614c0f0fb2e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082648 May 31 15:03:22.853148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 669/1347] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:23.870582 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:23.871214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:23.877642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:23.878082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:23.878859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:23.879342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:23.939736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:23.947232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-72ece433-f2e7-44bc-b0d0-5db126cd6950 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080485 May 31 15:03:23.947804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 679/1348] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:23 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:24.965017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:24.965642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:24.972534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:24.973604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:24.974418 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:24.974906 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:25.042559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:25.050637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6b587c2e-b7b8-40ed-b801-d04a5c8687f9 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089793 May 31 15:03:25.051286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 670/1349] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:26.068212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:26.068822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:26.075330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:26.075777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:26.076536 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:26.076971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:26.138618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:26.146720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-51491d66-a28f-4f10-ad6d-5051dee6605d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082906 May 31 15:03:26.147288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 680/1350] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:27.164053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:27.164726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:27.172045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:27.172502 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:27.173332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:27.173777 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:27.177363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=82 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:27.237800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:27.246243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-11161a0c-f421-46bf-8fb8-edaa0b348262 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086068 May 31 15:03:27.246856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 671/1351] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:27 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:28.263961 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:28.264576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:28.271778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:28.272265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:28.273032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:28.273466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:28.334704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:28.342208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-45bd86d2-a266-44be-a1db-dc0d566a851c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082160 May 31 15:03:28.342799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 681/1352] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:29.359767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:29.360361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:29.366848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:29.367301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:29.368056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:29.368489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:29.433612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:29.441120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-27bdcc47-25b1-444d-9539-35b3cd16e593 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085233 May 31 15:03:29.441708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 672/1353] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:29 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:30.458280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:30.458876 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:30.465294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:30.465739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:30.466490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:30.466952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:30.469485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=80 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:30.528999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:30.536988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5572f5f5-192a-4815-8e21-dcd2917c2bd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082756 May 31 15:03:30.537553 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 682/1354] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:30 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:31.553957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:31.554506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:31.556847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:31.562179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:31.562631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:31.563419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:31.563857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:31.624931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:31.632911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-06275f32-cc4c-45b1-95e5-1137df15a821 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083422 May 31 15:03:31.633469 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 673/1355] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:31 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:32.650557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:32.651388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:32.658587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:32.659071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:32.659885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:32.660325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:32.723903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:32.731464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9bb6129c-0e6d-4bb9-8c12-739ed54a5732 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084851 May 31 15:03:32.732034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 683/1356] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:33.747883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:33.748520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:33.755847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:33.755847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:33.756228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:33.756662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:33.824343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:33.832915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-55a46ff2-3478-4145-8691-c8ffbb4dab36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088867 May 31 15:03:33.833487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 674/1357] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:33 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:34.852411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:34.853127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:34.855975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:34.862107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:34.862566 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:34.863959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:34.864398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:34.930253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:34.937979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ed5c10b0-eb81-4bb7-9bb0-9034fe40d45f tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091475 May 31 15:03:34.938563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 684/1358] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:35.955265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:35.955902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:35.962928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:35.963465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:35.964285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:35.964767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:36.027361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:36.035423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aaf1e3d8-1b08-4a55-b3d8-5968e4168392 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083947 May 31 15:03:36.036001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 675/1359] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:37.052861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:37.053517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:37.060714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:37.061217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:37.062051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:37.062499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:37.134224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:37.142343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1879939e-5e90-4dde-8aea-c27772b3df3b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093650 May 31 15:03:37.142949 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 685/1360] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:37 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:38.160615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:38.161265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:38.168147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:38.168602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:38.169398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:38.169846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:38.236291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:38.244088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7499214b-4c39-48fa-a333-554fcea88e7a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087977 May 31 15:03:38.244663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 676/1361] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:39.261398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:39.262043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:39.268601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:39.269052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:39.269877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:39.270314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:39.335958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:39.344115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-16c6290b-1156-4a87-9120-e6fdfd760229 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086639 May 31 15:03:39.344709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 686/1362] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:40.365692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:40.366341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:40.373570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:40.374090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:40.375010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:40.375520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:40.455618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:40.464325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b746d422-6a8c-45f6-bbd2-e891a9c5724a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.102524 May 31 15:03:40.464982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 677/1363] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:40 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:03:41.483169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:41.483818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:41.490509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:41.490994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:41.491757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:41.492188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:41.561542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:41.572417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b548c97b-01a6-492a-ac9c-39d825fd1fff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092949 May 31 15:03:41.573113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 687/1364] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:42.591456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:42.592144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:42.600085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:42.600584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:42.601546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:42.601998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:42.670344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:42.678993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-131d54cb-67b7-4d63-9449-0ba74279bcad tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091782 May 31 15:03:42.679655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 678/1365] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:42 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:43.698209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:43.698974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:43.706430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:43.706927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:43.707697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:43.708165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:43.773095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:43.782908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-af73cd41-d054-454d-96a7-62fc35748259 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088916 May 31 15:03:43.783580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 688/1366] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:44.804254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:44.805048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:44.812510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:44.812972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:44.813949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:44.814447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:44.888404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:44.897255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-03344f8f-d90f-45ae-8c92-67c7fb4d12bc tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.098398 May 31 15:03:44.898270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 679/1367] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:44 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:45.918023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:45.918953 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:45.926790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:45.927361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:45.928363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:45.928844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:46.007866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:46.015645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-645419f0-2909-4d11-a4ad-f36118068f69 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.101993 May 31 15:03:46.016298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 689/1368] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:47.035245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:47.035897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:47.043246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:47.043702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:47.044504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:47.045213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:47.115221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:47.123708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5afce9ef-4051-4486-984c-23cb366ceeee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093038 May 31 15:03:47.124315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 680/1369] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:48.140907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:48.141519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:48.148070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:48.148516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:48.149279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:48.149710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:48.210987 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:48.218496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4959b770-ac2e-4d8d-918d-cf2c449ac935 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081526 May 31 15:03:48.219083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 690/1370] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:49.235882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:49.236504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:49.243077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:49.243527 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:49.244282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:49.244719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:49.307805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:49.315334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9095b543-c0fb-4faf-b842-d82efe9bb0d0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083337 May 31 15:03:49.316396 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 681/1371] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:50.332519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:50.333121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:50.339621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:50.340093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:50.340843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:50.341274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:50.403797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:50.412009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ef2b479c-f04b-47d6-926b-d38f126ad8aa tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083818 May 31 15:03:50.412580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 691/1372] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:51.429972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:51.430529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:51.437046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:51.437500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:51.438263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:51.438736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:51.502180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:51.509749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1ff67861-7382-4194-85fc-fb4bde6980c8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083725 May 31 15:03:51.510315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 682/1373] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:51 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:52.526849 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:52.527396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:52.533871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:52.534322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:52.535110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:52.535550 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:52.597369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:52.604943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b65792d8-c233-4219-901e-ff3217cd5f11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082129 May 31 15:03:52.605516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 692/1374] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:53.501128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:53.501719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:53.508227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:53.508681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:53.509457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:53.509897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:53.533213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-576a1c4a-78b0-449b-a653-7005148f9dd4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200/ips" status: 200 len: 151 microversion: 2.1 time: 0.036073 May 31 15:03:53.533773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 683/1375] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 15:03:53 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:03:53.622465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:53.623111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:53.630056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:53.630505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:53.631307 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:53.631748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:53.697776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:53.705518 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b525cccf-4447-487d-abba-ebb5b5cc791c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086914 May 31 15:03:53.706090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 693/1376] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:53 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:54.722844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:54.723450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:54.729893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:54.730379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:54.731180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:54.731628 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:54.797398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:54.805983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-99609611-1cee-462a-a966-c77e8946f62b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087029 May 31 15:03:54.806558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 684/1377] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:55.826887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:55.827782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:55.836260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:55.836763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:55.837615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:55.838112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:55.908050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:55.915889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-37e81802-55fd-43f8-86fa-847ea892d575 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.095032 May 31 15:03:55.916480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 694/1378] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:56.932800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:56.933505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:56.940068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:56.940515 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:56.941286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:56.941728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:57.004565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:57.012392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-faeb74b8-991c-4670-b0cf-d9143a9a4a97 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083422 May 31 15:03:57.012978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 685/1379] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:58.033334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:58.033951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:58.041285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:58.041744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:58.042524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:58.042997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:58.109834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:58.119120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ba626108-5b85-48e9-9e49-5727c1f3e837 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089533 May 31 15:03:58.119706 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 695/1380] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:58 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:03:59.136479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:03:59.137134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:03:59.144232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:59.144691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:59.145456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:03:59.145901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:03:59.149771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=88 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:59.206859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:03:59.214420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f8706fda-695f-4b4c-9cf4-e232dc415adf tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081769 May 31 15:03:59.215028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 686/1381] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:03:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:00.231537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:00.232156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:00.239116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:00.239570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:00.240345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:00.240794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:00.309192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:00.318286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e2c19a7e-70c1-4242-a45d-c0cdca67ee7c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090378 May 31 15:04:00.319257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 696/1382] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:01.335770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:01.336352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:01.343108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:01.343569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:01.344373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:01.344822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:01.411922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:01.419242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5021810c-6c28-417b-a664-6314444dc278 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087416 May 31 15:04:01.420069 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 687/1383] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:02.436643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:02.437212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:02.444222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:02.444663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:02.445427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:02.445855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:02.448505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:02.507918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:02.515834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fc909a4f-a37f-4066-ae25-97c1662f43e1 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083081 May 31 15:04:02.516412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 697/1384] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:02 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:03.532422 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:03.532997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:03.535555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:03.540963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:03.541421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:03.542205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:03.542675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:03.610094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:03.617839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-41291d1b-94f4-4a3f-8fe4-2867821d32a7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089435 May 31 15:04:03.618414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 688/1385] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:04.635231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:04.635871 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:04.643037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:04.643977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:04.644754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:04.645195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:04.712656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:04.720509 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-694640eb-aaf6-4476-8c4a-49ff8d531f6c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089226 May 31 15:04:04.721087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 698/1386] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:04 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:05.738259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:05.738889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:05.745378 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:05.745830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:05.746589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:05.747055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:05.807662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:05.815031 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fe9dd61c-12a9-455b-b470-ae77e6f46711 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080641 May 31 15:04:05.816085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 689/1387] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:06.832923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:06.833556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:06.835918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:06.841252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:06.841699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:06.842464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:06.842930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:06.903757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:06.911988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d16b81fc-d6aa-4817-99a9-4ef4cdb57a9a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083496 May 31 15:04:06.912563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 699/1388] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:07.929620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:07.930245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:07.936716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:07.937176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:07.937946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:07.938399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:07.999253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:08.006869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fc8072b3-358d-4950-86f0-fdc11bbba49d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081102 May 31 15:04:08.007438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 690/1389] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:09.025724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:09.026317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:09.033041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:09.033483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:09.034301 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:09.034766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:09.104830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:09.114091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0682a501-0eff-4e9f-a786-b8a9ed51ff5e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.093881 May 31 15:04:09.114931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 700/1390] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:09 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:10.134712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:10.135324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:10.141674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:10.142120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:10.142912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:10.143347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:10.206099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:10.213591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2244e36f-d6e6-4d63-a18e-b5e72faf420c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082714 May 31 15:04:10.214154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 691/1391] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:11.231088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:11.231709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:11.238656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:11.239123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:11.239887 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:11.240330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:11.301828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:11.309439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eb9157df-9699-41db-9e6c-0180bce42b54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082241 May 31 15:04:11.310003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 701/1392] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:12.326353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:12.327007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:12.333656 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:12.334115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:12.334914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:12.335361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:12.396659 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:12.404108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a4fdff7d-9f23-4a58-bcb9-d15b2bd73cf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081658 May 31 15:04:12.404671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 692/1393] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:13.421846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:13.422409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:13.429128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:13.429570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:13.430323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:13.430781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:13.494722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:13.502244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-576cc3fe-53c9-44e0-ad44-d646e49a279b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084592 May 31 15:04:13.502959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 702/1394] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:13 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:14.519400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:14.520010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:14.526375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:14.526862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:14.527647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:14.528125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:14.589305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:14.597257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-515947db-522f-41da-9bd8-b62b8cf45773 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081846 May 31 15:04:14.597821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 693/1395] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:14 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:15.613431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:15.614027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:15.620322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:15.620805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:15.621561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:15.621993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:15.685877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:15.695286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-78ee250e-1723-4f27-9ee0-a46b0c26b793 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085711 May 31 15:04:15.695909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 703/1396] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:15 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:16.713002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:16.713666 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:16.721076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:16.722049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:16.722893 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:16.723344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:16.790947 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:16.799236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-10815535-1553-43ae-b0e4-8a48b8b61194 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090148 May 31 15:04:16.799831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 694/1397] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:17.816947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:17.817591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:17.824351 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:17.824805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:17.825591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:17.826027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:17.893269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:17.900864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a853858e-2749-46c7-a9b2-6308745ee8a5 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088220 May 31 15:04:17.901437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 704/1398] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:18.918958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:18.919829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:18.926951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:18.927411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:18.928184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:18.928633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:18.991593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:18.999083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-34fee86e-19b3-45a4-9c5f-3c1a44f72e6d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083977 May 31 15:04:18.999655 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 695/1399] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:18 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:20.017232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:20.017872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:20.025029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:20.025479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:20.026315 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:20.026716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:20.087808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:20.096260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7c0bc7bd-3551-4175-bb8a-d39a0660d9d8 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082973 May 31 15:04:20.096833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 705/1400] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:20 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:21.113350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:21.113961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:21.120721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:21.121180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:21.121959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:21.122400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:21.183754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:21.191307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4f13f4d8-2d6b-48ba-8895-8c911d85148c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082056 May 31 15:04:21.191863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 696/1401] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:22.208768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:22.209373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:22.216385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:22.216844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:22.217603 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:22.218036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:22.281802 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:22.290016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-deb4a618-8013-402f-be24-f040444d62ce tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085741 May 31 15:04:22.290601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 706/1402] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:23.307395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:23.308005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:23.314748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:23.315211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:23.315984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:23.316427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:23.376860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:23.384360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4e2963d1-a02e-4f18-99e4-e62700fea7c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.080860 May 31 15:04:23.384873 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 697/1403] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:23 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:24.402486 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:24.403097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:24.409795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:24.410252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:24.411064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:24.411525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:24.558596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:24.566899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3ad8c90-bed6-4ff3-891c-ecb60e0b0b41 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.168955 May 31 15:04:24.567479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 707/1404] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:24 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:25.584260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:25.584874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:25.591536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:25.591999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:25.592764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:25.593211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:25.704065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:25.712426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d07cb90d-1313-4f82-befa-796cdd465845 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.132466 May 31 15:04:25.713019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 698/1405] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:25 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:26.729827 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:26.730420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:26.737328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:26.737815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:26.738588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:26.739053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:26.802510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:26.810091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-878816bb-53f0-4174-824b-9cbd9c3cde30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084136 May 31 15:04:26.810664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 708/1406] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:26 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:27.827642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:27.828241 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:27.834845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:27.835311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:27.836081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:27.836532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:27.897531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:27.904992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-513782f2-b861-46da-8684-7de61d2e5a60 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081214 May 31 15:04:27.905562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 699/1407] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:27 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:28.922495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:28.923157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:28.929842 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:28.930292 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:28.931093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:28.931583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:28.993310 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:29.004523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-19ecfa23-3094-4145-84ae-62530b63bdd4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086128 May 31 15:04:29.005100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 709/1408] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:28 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:04:30.022763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:30.023462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:30.030509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:30.031052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:30.031875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:30.032351 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:30.036350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:30.096743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:30.104286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2d95fc5e-dd96-4f45-bcaa-d38f811452b6 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086614 May 31 15:04:30.104852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 700/1409] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:30 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:31.121588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:31.122214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:31.129778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:31.130224 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:31.131420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:31.131620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:31.195965 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:31.203633 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-14a362b9-b64c-424a-b364-b5f74b861527 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086047 May 31 15:04:31.204204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 710/1410] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:31 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:32.222040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:32.222614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:32.231308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:32.232019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:32.232945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:32.233707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:32.300486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:32.308582 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3a3a70a4-942e-4f50-8832-8c8659485761 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091048 May 31 15:04:32.309187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 701/1411] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:32 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:33.326196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:33.326848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:33.334343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:33.334841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:33.335637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:33.336075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:33.338656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=84 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:33.400003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:33.407957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9299fab5-35a3-4acf-806e-fc73ff8abe19 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085620 May 31 15:04:33.408596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 711/1412] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:33 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:34.426571 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:34.427313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:34.429765 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:34.435735 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:34.436193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:34.436980 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:34.437424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:34.505709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:34.514140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d99155ce-0cf6-4b97-bcef-bb51f1334328 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092115 May 31 15:04:34.514773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 702/1413] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:34 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:35.532097 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:35.532722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:35.540729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:35.541186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:35.541979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:35.542426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:35.610385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:35.619234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-98af452b-bced-441f-9d4a-6d89de3887ee tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.091004 May 31 15:04:35.620095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 712/1414] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:35 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:04:36.637443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:36.638049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:36.645405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:36.645870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:36.646679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:36.647125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:36.713931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:36.723284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-84ab067b-9b69-48a0-8129-76772aa4386d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089677 May 31 15:04:36.723885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 703/1415] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:36 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:37.740655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:37.741316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:37.743729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:04:37.749533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:37.749985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:37.750793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:37.751230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:37.822199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:37.830475 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-54f9707d-4f74-4f0a-86dd-f820131c125a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094120 May 31 15:04:37.831128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 713/1416] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:37 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:04:38.849167 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:38.849825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:38.857108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:38.857696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:38.858739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:38.859269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:38.924758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:38.932685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-10cbfd2b-ba26-4d66-b759-68296e1f6369 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087738 May 31 15:04:38.933269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 704/1417] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:38 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:04:39.950845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:39.951558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:39.959142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:39.959597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:39.960385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:39.960826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:40.030252 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:40.039377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f2396745-fc2c-4530-80b0-6defff973062 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092640 May 31 15:04:40.039964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 714/1418] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:39 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:41.057095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:41.057691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:41.064761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:41.065292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:41.066204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:41.066759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:41.150115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:41.159492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9a58515e-e44f-42ad-a0c0-b0ed0f656e34 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.106269 May 31 15:04:41.160109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 705/1419] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:41 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:42.178031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:42.178739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:42.185839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:42.186289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:42.187125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:42.187588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:42.253460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:42.261638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-44c8a733-8dbc-4660-869d-c8d7c391338c tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087535 May 31 15:04:42.262220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 715/1420] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:42 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:43.280425 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:43.281054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:43.287698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:43.288148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:43.288927 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:43.289366 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:43.351799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:43.359370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-800e5a28-dda6-4d03-95e1-9a5ae354941b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083025 May 31 15:04:43.359937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 706/1421] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:43 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:44.377104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:44.377785 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:44.384024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:44.384476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:44.385269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:44.385691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:44.449691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:44.457551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f7e01413-7d83-4f5a-ab78-8bd968ca35ff tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085290 May 31 15:04:44.458134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 716/1422] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:44 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:45.474512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:45.475135 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:45.481789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:45.482242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:45.483118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:45.483567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:45.548157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:45.555668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cb0e40cf-8994-4e3b-8516-b11a94ff4d98 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085016 May 31 15:04:45.556236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 707/1423] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:45 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:46.573447 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:46.574018 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:46.581020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:46.581462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:46.582220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:46.582673 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:46.646253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:46.653917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-250358f0-34aa-4c89-a1af-17f8dca0668b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084530 May 31 15:04:46.654484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 717/1424] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:46 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:47.671806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:47.672433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:47.679608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:47.680071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:47.680843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:47.681286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:47.741650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:47.749263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aa329f58-21da-4378-85c1-fd13f468afd2 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081578 May 31 15:04:47.750030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 708/1425] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:47 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:48.766372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:48.767503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:48.774171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:48.774625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:48.775424 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:48.775861 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:48.839716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:48.847780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-13601562-7750-4873-b0bf-f1e7cb83d001 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085316 May 31 15:04:48.848350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 718/1426] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:48 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:49.865554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:49.866198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:49.872837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:49.873293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:49.874072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:49.874520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:49.941510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:49.949189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b33fe46c-36cd-416f-a780-b5f6a6b81198 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088212 May 31 15:04:49.949834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 709/1427] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:49 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:50.966344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:50.966972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:50.973567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:50.974013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:50.974800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:50.975234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:51.038496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:51.046426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5878bea1-ad4e-43d8-8e86-66917d85eaf4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083828 May 31 15:04:51.047114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 719/1428] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:50 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:52.063060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:52.064312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:52.070805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:52.071260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:52.072034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:52.072473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:52.134970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:52.143268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6ad0d411-9174-4938-bc1f-4fbe41e22d36 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084061 May 31 15:04:52.143842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 710/1429] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:52 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:53.161348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:53.161990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:53.169442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:53.169898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:53.170738 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:53.171192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:53.236817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:53.244483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d443f7d6-452e-44db-bef7-91d81c1f6b11 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087944 May 31 15:04:53.245056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 720/1430] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:53 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:04:54.260862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:54.261453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:54.267943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:54.268387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:54.269179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:54.269615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:54.334632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:54.343018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2f986696-1375-4acc-ac99-62677f16b609 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085951 May 31 15:04:54.343569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 711/1431] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:54 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:55.359993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:55.360614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:55.367260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:55.367718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:55.368489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:55.368932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:55.433866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:55.442100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cb96d4ce-bb30-4721-bda8-9de65e45048a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085979 May 31 15:04:55.442694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 721/1432] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:55 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:56.459645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:56.460242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:56.466859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:56.467311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:56.468084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:56.468524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:56.529598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:56.537878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1b8aae61-abae-4aa2-b855-2e23e680e743 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082059 May 31 15:04:56.538440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 712/1433] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:56 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:57.555668 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:57.556207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:57.562591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:57.563067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:57.563815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:57.564246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:57.627064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:57.634597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fb447bee-13b0-466c-8b3b-b1988eb287c0 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082855 May 31 15:04:57.635191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 722/1434] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:57 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:58.652439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:58.653065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:58.660269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:58.660809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:58.661524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:58.661971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:58.724304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:58.731870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38e057c0-c41c-4620-bbfe-34ed74de9e5a tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083552 May 31 15:04:58.732444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 713/1435] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:58 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:04:59.749169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:04:59.749957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:04:59.757642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:59.758078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:59.758933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:04:59.759386 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:04:59.824044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:04:59.832267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7a9e893e-2ab8-4746-a206-957e835ba3eb tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087070 May 31 15:04:59.832843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 723/1436] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:04:59 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:00.850993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:00.851616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:00.858086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:00.858539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:00.859341 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:00.859788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:00.862375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:00.922127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:00.929748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ca66543f-8f0e-461b-baf6-ff7d7d9b8dc3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082660 May 31 15:05:00.930319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 714/1437] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:00 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:05:01.946929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:01.947528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:01.954142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:01.954593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:01.955407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:01.955848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:02.020150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:02.027798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-05dbae0a-38d5-4d82-b6f3-f2e21ebb2d74 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084809 May 31 15:05:02.028378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 724/1438] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:01 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:03.045754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:03.046391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:03.053962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:03.054416 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:03.055252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:03.055696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:03.122866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:03.136682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1c6b5840-c2c7-4bb3-adeb-5385fae285a4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094671 May 31 15:05:03.137727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 715/1439] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:03 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:04.153358 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:04.153976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:04.160524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:04.160970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:04.161729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:04.162165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:04.166078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=84 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:04.223178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:04.230577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff7af792-d608-493f-901b-776b5210cbd3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.081110 May 31 15:05:04.231171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 725/1440] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:04 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:05.248977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:05.249554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:05.251975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:05.257443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:05.261245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:05.262158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:05.262698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:05.335604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:05.343243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-def7da66-52fe-4d5c-baa0-0e1f2a665027 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099499 May 31 15:05:05.344084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 716/1441] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:05 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:06.361621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:06.362267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:06.368728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:06.369164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:06.369910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:06.370346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:06.434024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:06.441644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f3e5ee2-d98c-431c-88b5-6e5c145f8ccd tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.084481 May 31 15:05:06.442217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 726/1442] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:06 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:07.458506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:07.459114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:07.465581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:07.466033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:07.466828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:07.467272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:07.529826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:07.537523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-703bba22-affb-40c9-9f72-341c44ecb653 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082910 May 31 15:05:07.538120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 717/1443] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:07 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:08.555032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:08.555728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:08.558226 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:08.564272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:08.564719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:08.565510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:08.566047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:08.631342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:08.639117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6cf55203-b99a-49bf-948e-f89f4e0070c4 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.088119 May 31 15:05:08.639703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 727/1444] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:08 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:09.656523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:09.657713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:09.664251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:09.664700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:09.665473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:09.665914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:09.727059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:09.734561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f496d2f4-ca09-4f41-9f56-91c7503b483e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082015 May 31 15:05:09.735163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 718/1445] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:09 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:10.752740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:10.753305 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:10.760221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:10.760677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:10.761457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:10.761896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:10.833507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:10.843503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e788bbe-9160-447b-99bf-526e2f72b73e tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.094696 May 31 15:05:10.844098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 728/1446] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:10 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:11.861456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:11.862124 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:11.868881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:11.869325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:11.870108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:11.870545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:11.934866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:11.942689 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-93b15cfd-0293-4509-804a-6fc477c43a30 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.085638 May 31 15:05:11.943261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 719/1447] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:11 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:05:12.960490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:12.961107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:12.967814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:12.968258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:12.969027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:12.970010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:13.035723 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:13.044247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-82b84aa0-68cc-4ee1-ac20-cae54fd7b901 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.087544 May 31 15:05:13.044845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 729/1448] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:12 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:14.061526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:14.062158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:14.068496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:14.068948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:14.069724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:14.070184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:14.133254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:14.141514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5d731885-81cd-4c82-9e26-d20b314f953b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083312 May 31 15:05:14.142091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 720/1449] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:14 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:15.158590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:15.159233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:15.165860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:15.166314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:15.167180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:15.167625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:15.236485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:15.244648 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-61ceb380-c12d-4f13-b1a5-0823794bab54 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089983 May 31 15:05:15.245291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 730/1450] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:15 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:16.263101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:16.263642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:16.270838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:16.271290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:16.272041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:16.272475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:16.335175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:16.342827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fce47ff3-b7ba-4cd2-92cc-59997accf507 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.083549 May 31 15:05:16.343403 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 721/1451] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:16 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:17.361761 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:17.362387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:17.369072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:17.369532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:17.370302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:17.370775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:17.432705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:17.440388 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-59534fd6-5b3c-47f5-a894-58f78b3ddc62 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082468 May 31 15:05:17.440977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 731/1452] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:17 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:18.105138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:05:18.105794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:05:18.302700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:05:18.302956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:05:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:05:18.456888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:18.457505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:18.464577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:18.465023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:18.465804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:18.466242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:18.536968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:18.545504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e40bf596-734f-405b-99a2-bac25b16c84b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.092672 May 31 15:05:18.546086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 722/1453] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:18 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:19.563769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:19.564400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:19.571498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:19.571774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:19.574273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:19.574273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:19.641740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:19.649889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-81e55a27-be43-4fb9-b7a9-b92310baf549 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.090038 May 31 15:05:19.650466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 732/1454] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:19 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:20.667464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:20.668062 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:20.675575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:20.676033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:20.676804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:20.677252 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:20.738881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:20.746499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0c08cd24-29ae-414c-bd27-b76da0314a0b tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.082920 May 31 15:05:20.747095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 723/1455] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:20 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:21.763771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:21.766606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:21.771931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:21.772369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:21.773134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:21.773561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:21.840065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:21.848889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-408bda28-ccd2-413e-a7a9-5b681547904d tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.089035 May 31 15:05:21.849473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 733/1456] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:21 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:22.866395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:22.867045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:22.873623 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:22.874072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:22.874870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:22.875307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:22.937796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:22.948959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-55463e6d-4890-4d8b-994d-928efa639235 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.086311 May 31 15:05:22.949536 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 724/1457] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:22 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:23.973598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:23.973598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: a83ddc26-cae5-4b25-8814-b23ca0401cfc] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:23.978767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:23.979229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:23.980018 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:23.980790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:24.056350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95d4208cdd30408bae5bcdc4d9941cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11689a303465495b9209f70dfb664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:24.064425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e0a8fb43-d2d4-46f8-a1b9-556d48b3d9f3 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc" status: 200 len: 1226 microversion: 2.1 time: 0.099158 May 31 15:05:24.065024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 734/1458] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:23 2022] GET /compute/v2.1/servers/a83ddc26-cae5-4b25-8814-b23ca0401cfc => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:24.519426 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:24.520103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:24.527040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:24.527512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:24.528305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:24.528758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:24.551056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] HTTP exception thrown: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Request method failure captured: May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 HTTP/1.1 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilij61ktRRlnDLlHoLthbTqT1lUlpU31H_bmFlexQBn7uAvCB9A4HsBvr2cQa9bG5XHD4NNOU6boGEQf-FEiaVQqCid5rMVzVB98sc-T5FhDJnyTzdCC06RaJI3iqWubmqRlGJoCQ8vKZnvR5ATudlCdoDDC2RQdt1oghtE60PZz1w3Q May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 21c11689a303465495b9209f70dfb664 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:05:24.553979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/21c11689a303465495b9209f70dfb664"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_21c11689a303465495b9209f70dfb664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 21c11689a303465495b9209f70dfb664 May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-TestVolumeBootPattern-180337677-project May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 95d4208cdd30408bae5bcdc4d9941cde May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-TestVolumeBootPattern-180337677-project May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.555639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '9d740346-523e-4ed4-990e-1c31c2bd0603'} May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:05:24.556535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.558108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:05:24.560199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Returning 404 to user: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:05:24.560199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24cc42e7-15ae-4643-9434-d605f6c26eca tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 404 len: 111 microversion: 2.1 time: 0.041547 May 31 15:05:24.560199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 725/1459] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:05:24 2022] DELETE /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:05:24.567068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:24.567677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] [instance: 9d740346-523e-4ed4-990e-1c31c2bd0603] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:24.575556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:24.576263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:24.577194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:24.577658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:24.592355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] HTTP exception thrown: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Request method failure captured: May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 HTTP/1.1 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilij61ktRRlnDLlHoLthbTqT1lUlpU31H_bmFlexQBn7uAvCB9A4HsBvr2cQa9bG5XHD4NNOU6boGEQf-FEiaVQqCid5rMVzVB98sc-T5FhDJnyTzdCC06RaJI3iqWubmqRlGJoCQ8vKZnvR5ATudlCdoDDC2RQdt1oghtE60PZz1w3Q May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 21c11689a303465495b9209f70dfb664 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:05:24.594066 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/21c11689a303465495b9209f70dfb664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/21c11689a303465495b9209f70dfb664"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_21c11689a303465495b9209f70dfb664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 21c11689a303465495b9209f70dfb664 May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-TestVolumeBootPattern-180337677 May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-TestVolumeBootPattern-180337677-project May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 95d4208cdd30408bae5bcdc4d9941cde May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-TestVolumeBootPattern-180337677-project May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.595897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '9d740346-523e-4ed4-990e-1c31c2bd0603'} May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:05:24.596794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. May 31 15:05:24.598385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:05:24.599636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Returning 404 to user: Instance 9d740346-523e-4ed4-990e-1c31c2bd0603 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:05:24.599636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ff04db9b-0870-438b-ae33-b314af8d21d7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603" status: 404 len: 111 microversion: 2.1 time: 0.032922 May 31 15:05:24.599636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 735/1460] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:24 2022] GET /compute/v2.1/servers/9d740346-523e-4ed4-990e-1c31c2bd0603 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:05:25.477478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:05:25.477793 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:05:26.518824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:05:26.519517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:05:42.673013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:05:42.673564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:05:48.154932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-928be824-4a60-433b-99c2-a18060d39f75 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Action: 'create', calling method: .version_select at 0x7f8dc8962310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-318445248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuQZk2iFv8Ll+zowXi01hl2DRs9puT6wkhle+VPjSqGNkb1qqzVfjkzJEqpZgz46I4au3BXkiAcPk/iI5aR5G/KeWEdN0TSF1eIGuo/DcMiZoznbck8F3pa5Vg+Pr+cBg=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:05:48.161241 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=19 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:48.162299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=67 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:48.183448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-928be824-4a60-433b-99c2-a18060d39f75 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Getting quotas for project f24fdc4bc9ca442e948484e73713779c. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:05:48.191248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-928be824-4a60-433b-99c2-a18060d39f75 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Getting quotas for user 180eebbd503e441b9332720e70f7f339 and project f24fdc4bc9ca442e948484e73713779c. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:05:48.243150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-928be824-4a60-433b-99c2-a18060d39f75 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.094353 May 31 15:05:48.243799 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 726/1461] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 15:05:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:05:48.297261 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-479236107", "imageRef": "50ee9065-1c79-4111-88d0-e4fff0a34ec9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-318445248", "networks": [{"uuid": "113498da-5151-45fc-ba20-4c38b85ac3db"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:05:48.305272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=17 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:48.306053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=61 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:48.366167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] validate_networks() for [('113498da-5151-45fc-ba20-4c38b85ac3db', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:05:48.774308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:05:48.774910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:05:48.775588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:05:48.776088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:05:48.776548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:05:48.787334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:48.787790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:48.788639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:48.789110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:48.810889 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Getting quotas for project f24fdc4bc9ca442e948484e73713779c. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:05:48.816060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Getting quotas for user 180eebbd503e441b9332720e70f7f339 and project f24fdc4bc9ca442e948484e73713779c. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:05:48.829886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:05:48.832298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='50ee9065-1c79-4111-88d0-e4fff0a34ec9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:05:48.898254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3520dba1-096b-4dc4-8e55-4d6e415c13c6 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606737 May 31 15:05:48.899430 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 736/1462] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:05:48.918435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dc1759a7-8470-45b2-a83c-e461936e49f8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:48.919948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dc1759a7-8470-45b2-a83c-e461936e49f8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:49.006737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dc1759a7-8470-45b2-a83c-e461936e49f8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:49.014384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dc1759a7-8470-45b2-a83c-e461936e49f8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1257 microversion: 2.1 time: 0.103837 May 31 15:05:49.015486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 727/1463] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:48 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1257 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:50.033370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:50.034081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:50.045216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:50.045669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:50.046751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:50.047198 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:50.150324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:50.164825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-41500a55-5471-456a-8d66-881797ac83dc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1317 microversion: 2.1 time: 0.136533 May 31 15:05:50.166031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 737/1464] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:50 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:51.196727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:51.197869 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:51.221727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:51.223065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:51.225467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:51.226929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:51.567117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:51.582531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-de404fd4-9aee-4218-a0bc-b1b997c3e260 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.393480 May 31 15:05:51.584311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 728/1465] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:51 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:52.606511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:52.607657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:52.619868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:52.620638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:52.622065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:52.622858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:52.811846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:52.824482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3b054267-acfb-4e0a-96ef-221edcdbd73a tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.222505 May 31 15:05:52.825623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 738/1466] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:52 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:53.843761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:53.844495 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:53.852233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:53.853090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:53.853970 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:53.854803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:54.053733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:54.063769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c90f7b4e-78ae-421b-96f1-386d2e3eaeeb tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.225529 May 31 15:05:54.064808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 729/1467] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:53 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:55.085741 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:55.086927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:55.098354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:55.099159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:55.100850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:55.101983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:55.284960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:55.295150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-10f7a4d6-ccf6-4928-a17f-f235e72613b7 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.217350 May 31 15:05:55.295748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 739/1468] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:55 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:56.317721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:56.318435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:56.325034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:56.325510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:56.326329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:56.326805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:56.513581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:56.521040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cc58b5e5-bea3-409f-9978-7d3c1ff22a0c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.207076 May 31 15:05:56.522193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 730/1469] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:56 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:05:57.541039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:57.542400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:57.550568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:57.551089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:57.552204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:57.552960 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:57.725291 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:57.735050 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b5e50ea2-b102-4ede-b78f-734a2ae05c18 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.198767 May 31 15:05:57.735670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 740/1470] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:57 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:58.752974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:58.753722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:58.760494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:58.760956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:58.761733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:58.762181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:58.915911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:05:58.923894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-84fffe11-fd12-4035-90e9-8f0b97eb7bc5 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.174852 May 31 15:05:58.924478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 731/1471] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:58 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:05:59.942333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:05:59.943048 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:05:59.945338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:59.946167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:05:59.952519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:59.952966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:05:59.953746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:05:59.954180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:00.094596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:00.103089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a1761597-58c5-4c77-ac56-4a4187e04ecf tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.164677 May 31 15:06:00.103835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 741/1472] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:05:59 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:06:01.123225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:01.123938 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:01.126012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:06:01.132759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:01.133728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:01.133990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:01.134434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:01.277467 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:01.285736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-791907a4-6f57-4cee-9a31-e3effd368808 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.167218 May 31 15:06:01.286332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 732/1473] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:01 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:06:02.303524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:02.304166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:02.311748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:02.312246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:02.313094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:02.313579 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:02.457814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:02.465610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f6b09e4d-8d55-4156-aee9-7e1720e1cb9e tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.165922 May 31 15:06:02.466192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 742/1474] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:02 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:06:03.485297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:03.486870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:03.494223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:03.494908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:03.495985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:03.496562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:03.740075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:03.750192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-35991428-56b2-4d75-a21c-01beed7ba268 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.269638 May 31 15:06:03.751163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 733/1475] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:03 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:04.024027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-8579da41-1f5f-4773-9654-b3588a5eab81 req-94a85d3a-d4b5-400b-b50d-67514652963a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621277b0-46a9-4b52-a8d8-c9a618c7b553", "tag": "fb91d4b0-cf6e-4ab1-a335-d00d30643dec"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:06:04.036243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-8579da41-1f5f-4773-9654-b3588a5eab81 req-94a85d3a-d4b5-400b-b50d-67514652963a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:04.036762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-8579da41-1f5f-4773-9654-b3588a5eab81 req-94a85d3a-d4b5-400b-b50d-67514652963a service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:04.052591 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-8579da41-1f5f-4773-9654-b3588a5eab81 req-94a85d3a-d4b5-400b-b50d-67514652963a service nova] Creating event network-changed:fb91d4b0-cf6e-4ab1-a335-d00d30643dec for instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 on hv-cinder-83979 May 31 15:06:04.060496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-8579da41-1f5f-4773-9654-b3588a5eab81 req-94a85d3a-d4b5-400b-b50d-67514652963a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248999 May 31 15:06:04.061281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 743/1476] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:06:04.771877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:04.772876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:04.784111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:04.784912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:04.786156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:04.787109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:04.939634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:04.951150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-80fdafe3-5053-4914-a0c1-c8e0750c60fc tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.185555 May 31 15:06:04.951779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 734/1477] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:04 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:05.969227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:05.970013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:05.976715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:05.977169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:05.977952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:05.978396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:06.129119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:06.138185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-20482521-11c2-41d5-b883-793794a64d6b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.173678 May 31 15:06:06.138809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 744/1478] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:05 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:07.156332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:07.156950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:07.163817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:07.164264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:07.165041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:07.165477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:07.321411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:07.330024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ee0f798c-4cbd-451b-ae6e-bb0e87d58850 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.178367 May 31 15:06:07.330607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 735/1479] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:07 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:08.349655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:08.350376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:08.356914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:08.357341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:08.358115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:08.358707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:08.501322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:08.509476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ae94b04d-172a-4d42-8526-511cbf482d95 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.163586 May 31 15:06:08.510085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 745/1480] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:08 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:09.527561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:09.528163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:09.535061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:09.535510 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:09.536265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:09.536700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:09.667702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:09.675645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-827472ee-da2e-4b91-a030-358b15709b90 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.152135 May 31 15:06:09.676220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 736/1481] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:09 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:09.981618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-e4f72f11-7949-45be-a24d-7a35df73a2db req-e84293cd-7c2d-4ba6-9df0-aec41a029301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621277b0-46a9-4b52-a8d8-c9a618c7b553", "name": "network-vif-plugged", "status": "completed", "tag": "fb91d4b0-cf6e-4ab1-a335-d00d30643dec"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:06:09.991070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-e4f72f11-7949-45be-a24d-7a35df73a2db req-e84293cd-7c2d-4ba6-9df0-aec41a029301 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:09.991659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-e4f72f11-7949-45be-a24d-7a35df73a2db req-e84293cd-7c2d-4ba6-9df0-aec41a029301 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:10.005886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-e4f72f11-7949-45be-a24d-7a35df73a2db req-e84293cd-7c2d-4ba6-9df0-aec41a029301 service nova] Creating event network-vif-plugged:fb91d4b0-cf6e-4ab1-a335-d00d30643dec for instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 on hv-cinder-83979 May 31 15:06:10.011313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-e4f72f11-7949-45be-a24d-7a35df73a2db req-e84293cd-7c2d-4ba6-9df0-aec41a029301 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 May 31 15:06:10.012094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 746/1482] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:06:10.692647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:10.693191 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:10.699860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:10.700309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:10.701091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:10.702016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:10.835270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:10.843488 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0c7971fc-1bc1-4e73-a299-bc02ac6a5134 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.154737 May 31 15:06:10.844073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 737/1483] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:10 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:11.861629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:11.862334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:11.869495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:11.869952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:11.870754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:11.871201 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:12.239795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:12.252670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-656789a9-fa53-4d86-ac0e-e85945b7e224 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1357 microversion: 2.1 time: 0.395885 May 31 15:06:12.253280 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 747/1484] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:11 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:13.269757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:13.270363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:13.276520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.276968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.277732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.278194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.407709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:13.415578 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-99a9602b-a34c-43fa-860e-7c9f4b25d315 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1548 microversion: 2.1 time: 0.149889 May 31 15:06:13.416171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 738/1485] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:13 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:06:13.433277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:13.434041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:13.440482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.440936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.441710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.442153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.598465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:13.606061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-aa0cb9a2-c111-428a-9b3c-96b4ecb83e3b tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1548 microversion: 2.1 time: 0.178020 May 31 15:06:13.606629 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 748/1486] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:13 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:06:13.621676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:13.625172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:13.625957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Searching by: {'deleted': False, 'project_id': 'f24fdc4bc9ca442e948484e73713779c'} {{(pid=124107) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 31 15:06:13.632775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.633223 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.634025 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.634463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.726558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.multi_cell_list [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124107) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 31 15:06:13.819480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24eb5bbe-eb39-40b8-a263-66967258cf8d tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201440 May 31 15:06:13.820074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 739/1487] 10.222.0.67 () {58 vars in 1124 bytes} [Tue May 31 15:06:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:06:13.832495 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:06:13.833110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:06:13.839246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.839695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.840456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:06:13.840886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:06:13.972009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:06:13.979728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d8a8fbbc-b124-47c0-8273-044a9fa376b8 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1548 microversion: 2.1 time: 0.150942 May 31 15:06:13.980391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 749/1488] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:06:13 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:07:25.929312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:25.930992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:25.934332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:25.936071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:25.945693 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=74 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:25.949646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:25.950344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:25.951211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:25.951658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:25.983632 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3d59c4e-74f3-4766-902b-304c25e2a0a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063174 May 31 15:07:25.984309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 740/1489] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:26.993322 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:26.994290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=72 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:26.999434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:27.000365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:27.008398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:27.008854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:27.009639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:27.010082 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:27.041691 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7bd1a60f-058d-4d0b-be5d-d86bf8823d82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049917 May 31 15:07:27.042258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 750/1490] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:28.053489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:28.054444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:28.061076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:28.061517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:28.062280 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:28.062738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:28.092820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d204e42b-06ac-44d6-af39-e84d2350fdae tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043342 May 31 15:07:28.093760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 741/1491] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:29.104897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:29.105858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:29.113170 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:29.113623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:29.114437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:29.114931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:29.146612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-797ece2f-9c2a-446e-9a19-047f5eb7da29 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046013 May 31 15:07:29.147212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 751/1492] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:30.157477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:30.158390 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:30.164825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:30.165350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:30.166289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:30.166753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:30.195788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-61889e56-e928-4a0e-a7a7-0991781407cd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042204 May 31 15:07:30.196342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 742/1493] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:31.207695 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:31.208621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:31.215095 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:31.215548 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:31.216883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:31.217326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:31.246326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-70f5c7c8-7121-4615-ade1-9dda25114ad1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042552 May 31 15:07:31.246911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 752/1494] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:32.258151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:32.259144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:32.265574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:32.266024 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:32.266890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:32.267349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:32.297642 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e0e3e9ad-4048-4772-a0c8-41fae69bf34e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043445 May 31 15:07:32.298193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 743/1495] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:33.308787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:33.310314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:33.316806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:33.317259 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:33.318025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:33.318471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:33.347483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a3a3dd54-4c0d-4de6-b799-1bf7119e6ba3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042625 May 31 15:07:33.348036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 753/1496] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:34.359747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:34.360731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:34.367172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:34.367630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:34.368392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:34.368838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:34.398853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fac9ea2a-25be-4a45-9ff4-353fecb4c62e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043502 May 31 15:07:34.399438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 744/1497] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:35.410288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:35.411260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:35.417992 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:35.418443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:35.419833 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:35.420275 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:35.449929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e32d14b1-210c-4851-b605-bf9a19a2067f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043615 May 31 15:07:35.450635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 754/1498] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:36.461727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:36.462684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:36.469239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:36.469696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:36.470468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:36.470937 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:36.504705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1de98662-927d-4e5f-b886-e5a92f9b8c14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046879 May 31 15:07:36.505172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 745/1499] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:37.517614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:37.518458 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:37.525130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:37.525577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:37.526378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:37.526855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:37.556126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b911e27b-1a1d-4f03-9173-f63717017cb2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043679 May 31 15:07:37.556716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 755/1500] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:38.568945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:38.569880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:38.576833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:38.577291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:38.578060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:38.578503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:38.608100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dfc3ae3e-9e76-41c5-966a-ebfc7eddfac8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043185 May 31 15:07:38.608661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 746/1501] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:39.619824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:39.620734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:39.627831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:39.628275 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:39.629033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:39.629460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:39.659300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cc1a4a32-7ced-47ca-9378-285ab1bffd0e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043375 May 31 15:07:39.659853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 756/1502] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:40.671930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:40.672773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:40.679205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:40.679662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:40.680448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:40.680889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:40.710212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e48536c9-4952-42bf-9857-e18d1b3a3e6e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042890 May 31 15:07:40.710814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 747/1503] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:41.722875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:41.723809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:41.730412 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:41.730909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:41.731792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:41.732237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:41.764157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a50ff120-8e76-47ae-901d-464454e555e1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045322 May 31 15:07:41.764721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 757/1504] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:42.777114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:42.777944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:42.784172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:42.784620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:42.785380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:42.785816 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:42.816580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f81ea2ac-1289-431b-b9c5-1e0bb6c45d4c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044481 May 31 15:07:42.817146 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 748/1505] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:43.828626 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:43.829552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:43.836164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:43.836618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:43.837390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:43.837825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:43.868507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5f74266c-6eaa-41f8-a2c1-f9ecfa03adb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043891 May 31 15:07:43.869081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 758/1506] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:44.880485 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:44.881405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:44.887565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:44.888027 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:44.888791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:44.889228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:44.918434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fc7c22ff-9a36-43c0-8e4a-a64a773801ce tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042142 May 31 15:07:44.919585 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 749/1507] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:45.930122 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:45.931128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:45.937258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:45.937705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:45.938465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:45.938922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:45.970781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8a7050ca-f873-45b3-8415-e4931b4b2e14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044458 May 31 15:07:45.971532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 759/1508] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:46.983411 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:46.984344 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:46.991364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:46.991827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:46.992606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:46.993051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:47.025925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-575fc1b9-3868-4299-8599-f1af92eb490b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046968 May 31 15:07:47.026504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 750/1509] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:48.037749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:48.038680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:48.045569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:48.046017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:48.046804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:48.047237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:48.077644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9e1f33a5-5124-4bee-86e0-819097c1ed66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043955 May 31 15:07:48.078214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 760/1510] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:49.089427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:49.091195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:49.097990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:49.098444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:49.099239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:49.099676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:49.131976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f496ea62-31fc-4822-b8fe-9633fe9b372e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046170 May 31 15:07:49.132959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 751/1511] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:50.154496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:50.155642 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:50.162104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:50.162555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:50.163350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:50.163788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:50.193392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-58fe92be-6f7b-461f-8aa8-56a90f4d20d7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042933 May 31 15:07:50.193950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 761/1512] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:51.205756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:51.206708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:51.213335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:51.213791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:51.214576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:51.215050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:51.248997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4841aa44-1c71-4de7-81a3-5242f80b33be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047247 May 31 15:07:51.249560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 752/1513] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:52.260657 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:52.261589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:52.268599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:52.269054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:52.269812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:52.270258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:52.305361 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-14b5902b-c97c-410a-87b6-a3fafb96407a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048783 May 31 15:07:52.305925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 762/1514] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:53.317368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:53.318289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:53.324801 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:53.325281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:53.326055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:53.326499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:53.356890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-43579ba1-1fbd-4ee9-8f50-e7af2f6fa533 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042931 May 31 15:07:53.357456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 753/1515] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:54.368672 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:54.369844 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:54.377665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:54.378107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:54.378920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:54.379487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:54.410436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f4fc113-ed70-4828-ab63-92ff4e67f09f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045681 May 31 15:07:54.411055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 763/1516] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:55.422183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:55.423128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:55.429700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:55.430153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:55.430967 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:55.431402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:55.461448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5e366cd9-ff81-4da5-aac0-91462111ff47 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043283 May 31 15:07:55.462010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 754/1517] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:56.473287 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:56.474216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:56.481714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:56.482176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:56.482985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:56.483439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:56.517090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-983ebd8a-535d-43a0-9681-26f114139f5c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047713 May 31 15:07:56.517694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 764/1518] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:57.529763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:57.530609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:57.532986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=31 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:57.538427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:57.538911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:57.539685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:57.540125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:57.543003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=91 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:57.572189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dcc6654f-8d88-4381-8d8e-fb67eccde21d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047039 May 31 15:07:57.572755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 755/1519] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:58.584472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:58.585416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:58.587797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=31 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:58.593912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:58.594354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:58.595145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:58.595577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:58.598133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=91 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:07:58.626578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c702e554-da4a-4a3e-a135-68ebac3d518a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046030 May 31 15:07:58.627177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 765/1520] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:07:59.638572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:07:59.639648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:07:59.646362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:59.646862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:59.647758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:07:59.648203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:07:59.679630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2c3a5e35-c01a-42ea-b92e-f41602f79f7d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045196 May 31 15:07:59.680208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 756/1521] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:07:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:08:00.691792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:00.692631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:00.700329 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:00.700773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:00.701546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:00.701980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:00.741558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a220161-a9f6-49cd-b066-9d4d2084df21 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053738 May 31 15:08:00.742142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 766/1522] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:01.754452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:01.755539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:01.762183 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:01.762637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:01.763435 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:01.763872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:01.796309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9f039e86-f84f-45d0-99df-ef09fcb2f3e3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045901 May 31 15:08:01.796885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 757/1523] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:08:02.807943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:02.809452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:02.815875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:02.816321 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:02.817077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:02.817508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:02.846620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b17d2037-2972-4031-a4b6-511a3ef779a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042665 May 31 15:08:02.847205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 767/1524] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:03.857615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:03.858559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:03.864956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:03.865403 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:03.866254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:03.866664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:03.896368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-175a7aee-0a1c-4a3e-a7da-9bd267018d3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042675 May 31 15:08:03.896928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 758/1525] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:04.908905 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:04.909828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:04.916692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:04.917144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:04.917918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:04.918359 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:04.950156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-73f7b948-17f6-4ff9-b409-a5fd17579090 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044662 May 31 15:08:04.950763 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 768/1526] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:05.962095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:05.963080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:05.969639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:05.970107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:05.970916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:05.971359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:06.001195 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8a3bb5e3-7fec-4421-aa08-43cf031eaf5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043102 May 31 15:08:06.001764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 759/1527] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:07.013721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:07.014680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:07.021374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:07.021809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:07.022574 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:07.023060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:07.055355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eb5fd994-c261-4c73-8fd5-9566bc629217 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046041 May 31 15:08:07.055927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 769/1528] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:08.069092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:08.070386 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:08.077436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:08.077885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:08.078673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:08.079114 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:08.109653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a98d6f19-2b3f-4dc4-a890-1f682246bf48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046379 May 31 15:08:08.110218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 760/1529] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:09.124595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:09.126826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:09.138338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:09.139197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:09.140465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:09.140917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:09.172721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-83b4b97c-8d6b-44c9-a89d-7bf7748ecd98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054739 May 31 15:08:09.173286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 770/1530] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:10.185099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:10.186003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:10.192472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:10.192918 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:10.193679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:10.194107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:10.223236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d7f0089c-a504-41cc-ad8d-d3f605025c4f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042740 May 31 15:08:10.223785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 761/1531] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:11.234966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:11.235898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:11.242507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:11.243019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:11.243793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:11.244232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:11.274858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-df518849-c782-4a92-a4fd-eca00170109e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043793 May 31 15:08:11.275373 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 771/1532] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:12.285508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:12.286430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:12.293247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:12.294039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:12.294847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:12.295286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:12.324731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d258ad6-33ab-4c05-84b9-ec2c9f49e51d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042683 May 31 15:08:12.325291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 762/1533] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:13.336508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:13.337338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:13.343938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:13.344390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:13.345146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:13.345580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:13.375947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-11e9a07a-b816-40fc-8a47-0155755e00a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043467 May 31 15:08:13.376514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 772/1534] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:14.388514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:14.389463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:14.395460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:14.395914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:14.396673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:14.397113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:14.426399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c7318bd1-acb9-42d0-a03c-78cb93c0a9ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042582 May 31 15:08:14.426976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 763/1535] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:15.438033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:15.439012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:15.445067 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:15.445513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:15.446293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:15.446753 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:15.476677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-be44d913-1abe-40dc-8715-f37097265798 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042822 May 31 15:08:15.477232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 773/1536] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:16.487458 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:16.488389 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:16.494872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:16.495337 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:16.496193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:16.496637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:16.525592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6fd9678b-666e-46aa-835d-8c4e48f05a76 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042074 May 31 15:08:16.526151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 764/1537] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:17.538076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:17.538930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:17.545764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:17.546267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:17.546988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:17.547421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:17.577845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bf6dac94-df81-4579-a072-2b023a418030 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043783 May 31 15:08:17.578394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 774/1538] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:18.590232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:18.591184 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:18.598083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:18.598545 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:18.599356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:18.599798 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:18.629863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-db75d4bb-ca3a-4696-a191-01d57211a201 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044216 May 31 15:08:18.630437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 765/1539] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:19.641885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:19.642832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:19.649672 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:19.650115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:19.650903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:19.651340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:19.683948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0e2a86be-687b-4a63-af96-7f80e62f2500 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046022 May 31 15:08:19.684531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 775/1540] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:20.695998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:20.696844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:20.703376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:20.703835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:20.704604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:20.705055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:20.735787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-43455b0d-1060-4f6d-be2b-03b500bb6a6b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043792 May 31 15:08:20.736381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 766/1541] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:21.748037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:21.748948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:21.755482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:21.755927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:21.756690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:21.757121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:21.787577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-156eac03-0d92-42bc-aa82-25d597c2f81e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043962 May 31 15:08:21.788130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 776/1542] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:22.800253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:22.801112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:22.807847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:22.808302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:22.809082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:22.809533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:22.840973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-382bf262-8da5-42c8-94ad-02ca21a7c69f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045256 May 31 15:08:22.841647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 767/1543] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:23.852966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:23.853891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:23.860979 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:23.861440 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:23.862211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:23.862671 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:23.893035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ddf9063e-eba8-4f9f-8b61-ce2d5ee71268 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044020 May 31 15:08:23.893622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 777/1544] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:24.904812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:24.905763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:24.912256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:24.912709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:24.913472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:24.913912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:24.949110 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-60530944-348a-48cc-b038-23d6073aab5d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047640 May 31 15:08:24.949723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 768/1545] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:25.960966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:25.961877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:25.969119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:25.969568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:25.970324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:25.970782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:26.002656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-da332512-53e1-4b69-9b9d-73bdef9fffd4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045585 May 31 15:08:26.003245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 778/1546] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:27.015760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:27.016668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:27.023221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:27.023671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:27.024439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:27.024882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:27.056583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b1e077af-b800-42e4-b21d-a4c1eaadc347 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046341 May 31 15:08:27.057179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 769/1547] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:28.068387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:28.069305 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:28.075883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:28.076318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:28.077076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:28.077508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:28.109019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dae8b48b-6750-4578-839c-1982097645ea tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044562 May 31 15:08:28.109602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 779/1548] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:29.122082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:29.123216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:29.125872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:08:29.132490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:29.132627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:29.133450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:29.133958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:29.138161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:08:29.169020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1509c13b-0fdc-46f2-a2f1-f511dc22a02e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052138 May 31 15:08:29.169807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 770/1549] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:30.181529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:30.182452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:30.184901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:08:30.192076 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:30.192815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:30.194071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:30.194878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:30.201346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:08:30.231026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7fa4941b-4f29-4721-ac19-d564ff66ace7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053545 May 31 15:08:30.231618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 780/1550] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:31.243679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:31.245875 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:31.255874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:31.256608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:31.257882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:31.258595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:31.308838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-35249e74-790f-4d04-b17b-785ccaf69566 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068126 May 31 15:08:31.309878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 771/1551] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:32.321090 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:32.322025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:32.329314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:32.329771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:32.330665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:32.330998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:32.361612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2ad93b5d-98b9-4e9e-87e5-bc2a50c8fd3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044481 May 31 15:08:32.362182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 781/1552] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:33.372680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:33.373608 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:33.380037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:33.380565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:33.381266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:33.381710 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:33.412540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7a9f4055-a25b-4657-88f1-60e1c5021389 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043799 May 31 15:08:33.413108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 772/1553] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:34.424505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:34.425438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:34.432007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:34.432462 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:34.433260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:34.433661 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:34.465092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-af1570ad-5e4a-4dcc-9224-9f4603032a7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044516 May 31 15:08:34.465659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 782/1554] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:35.476702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:35.477625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:35.484609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:35.485067 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:35.485835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:35.486274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:35.516830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fbb346cc-bcd5-4b5e-a442-563a3bcf990a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044040 May 31 15:08:35.517400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 773/1555] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:36.528502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:36.529429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:36.535929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:36.536385 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:36.537157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:36.537596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:36.568573 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d41436c0-b60a-45ba-90a4-1d17d469d207 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043951 May 31 15:08:36.569149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 783/1556] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:37.582379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:37.583333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:37.589856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:37.590307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:37.591113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:37.591556 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:37.622888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5ecc283a-9fa7-4313-a01f-c5a0e0c28576 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045082 May 31 15:08:37.623453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 774/1557] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:38.113985 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:08:38.114312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:08:38.310923 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:08:38.311504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:08:38.633791 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:38.634756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:38.642128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:38.642489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:38.643327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:38.643769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:38.674674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eaa24dd5-53a7-431b-8527-35af99b60a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044686 May 31 15:08:38.675166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 784/1558] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:39.685963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:39.686928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:39.693615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:39.694090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:39.694922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:39.695359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:39.725891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b979ece4-be88-4a83-aeec-062b124cfa0b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044406 May 31 15:08:39.726438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 775/1559] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:40.741215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:40.742768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:40.753126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:40.753865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:40.755443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:40.756664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:40.790455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-11425a84-d598-4902-a8b8-947bd340cda5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055884 May 31 15:08:40.791038 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 785/1560] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:41.802060 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:41.803120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:41.810449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:41.810946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:41.811729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:41.812261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:41.841924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e4ad7f89-f086-4440-82e5-2fa004ed99b1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044326 May 31 15:08:41.842487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 776/1561] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:42.854028 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:42.855031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:42.861487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:42.861940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:42.862729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:42.863162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:42.893907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a39d2f3-86b3-4394-bbef-5370c9dcebf7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043808 May 31 15:08:42.894464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 786/1562] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:43.906315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:43.907277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:43.913368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:43.913827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:43.914902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:43.915346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:43.944688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1a92b199-fd93-405f-ae6a-ff45df081922 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043025 May 31 15:08:43.945240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 777/1563] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:44.958578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:44.959538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:44.966314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:44.966799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:44.967571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:44.968013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:44.999496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fbdfefb0-c754-4f23-a91b-231129c9b70f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045011 May 31 15:08:45.000263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 787/1564] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:45.488190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:08:45.488749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:08:46.011664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:46.012588 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:46.019375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:46.019830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:46.020605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:46.021051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:46.052141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2b6cf03f-ab24-431a-bcc0-2f7bb2e93be5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044800 May 31 15:08:46.052701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 778/1565] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:46.530479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:08:46.531031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:08:47.064012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:47.064938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:47.071530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:47.071975 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:47.072737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:47.073655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:47.103809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1b0bf044-980b-4bc7-9b02-ca3c5832d69e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043795 May 31 15:08:47.104413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 788/1566] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:48.115437 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:48.116362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:48.123056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:48.123513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:48.124294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:48.124732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:48.156861 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2793b03a-1afa-404b-a1c0-ab50165d9563 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045295 May 31 15:08:48.157429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 779/1567] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:49.169231 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:49.170157 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:49.176728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:49.177184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:49.177955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:49.178398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:49.208639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1b4682bf-de84-4416-97e0-d6bcc58ae17b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044125 May 31 15:08:49.209203 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 789/1568] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:50.220185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:50.221037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:50.227581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:50.228032 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:50.228786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:50.229222 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:50.259111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-470480b9-599f-43a9-b763-cba403a65649 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042815 May 31 15:08:50.259651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 780/1569] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:51.271454 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:51.272381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:51.279593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:51.280043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:51.280809 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:51.281248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:51.312750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6b5cf307-2d24-4a71-9d0a-89a51ca3c538 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045261 May 31 15:08:51.313316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 790/1570] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:52.324431 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:52.325387 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:52.331771 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:52.332225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:52.332987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:52.333424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:52.363080 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-419f05fc-4fe6-4e66-95a9-c8a03685ff59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042537 May 31 15:08:52.363698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 781/1571] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:53.375804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:53.376957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:53.383335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:53.383728 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:53.384492 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:53.384933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:53.414722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4a37c109-fed5-4071-ae8b-1f9f2e5f0758 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042766 May 31 15:08:53.415293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 791/1572] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:54.425305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:54.426235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:54.432730 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:54.433185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:54.433953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:54.434395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:54.464072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-85fd4188-afc4-497a-8793-3d54098110f5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042663 May 31 15:08:54.465397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 782/1573] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:55.476369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:55.477324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:55.484594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:55.485042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:55.485808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:55.486244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:55.516618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f0e2426-2257-4cf8-9433-96954fc37a59 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044201 May 31 15:08:55.517174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 792/1574] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:56.528121 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:56.529049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:56.535862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:56.536327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:56.537094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:56.537537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:56.567419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-05135944-3041-4b73-8a67-ad7599514683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043219 May 31 15:08:56.567968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 783/1575] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:57.579575 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:57.580512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:57.587135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:57.587578 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:57.588330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:57.588764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:57.618021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-17e96cf9-353e-4c7f-b831-ffde2475c750 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042376 May 31 15:08:57.618563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 793/1576] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:58.630107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:58.631163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:58.637607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:58.638054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:58.638915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:58.639353 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:58.669075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-997bea94-ace7-41ed-a1c0-f18cca981171 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042970 May 31 15:08:58.669620 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 784/1577] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:08:59.680507 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:08:59.681423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:08:59.688538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:59.688990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:59.689744 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:08:59.690178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:08:59.718942 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-aa3ba9e7-3345-40a9-b1c7-f34bd06f9d09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042349 May 31 15:08:59.719491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 794/1578] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:08:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:00.730661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:00.731581 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:00.733987 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:00.739087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:00.739548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:00.740327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:00.740775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:00.744852 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:00.777936 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6e23edc3-1feb-4246-bc3d-26c866607cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051200 May 31 15:09:00.778505 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 785/1579] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:01.790012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:01.791003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:01.793417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:01.798890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:01.799346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:01.800112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:01.800552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:01.803413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:01.831704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-54bfb12c-5a6d-42af-aceb-1f0ab3205b39 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045988 May 31 15:09:01.832276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 795/1580] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:02.681472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:09:02.682042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:09:02.843022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:02.843943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:02.850439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:02.850931 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:02.851732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:02.852175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:02.881849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-66a45678-723d-4833-92c7-87a4fabe1f5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043293 May 31 15:09:02.882402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 786/1581] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:03.893450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:03.894368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:03.900855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:03.901302 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:03.902065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:03.902502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:03.931408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-28036c2d-6fb7-4a6d-996b-c784f3eee435 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041834 May 31 15:09:03.931973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 796/1582] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:04.942804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:04.943743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:04.951757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:04.952214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:04.952998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:04.953438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:04.985221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-071b9293-505f-460d-ba62-9b829179ea90 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046447 May 31 15:09:04.985797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 787/1583] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:05.997043 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:05.998005 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:06.004638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:06.005093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:06.005875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:06.006324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:06.039938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ea80d15c-6cef-4d40-8485-8a8aa6adb508 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046629 May 31 15:09:06.040511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 797/1584] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:07.051943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:07.052864 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:07.060194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:07.060645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:07.061478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:07.061914 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:07.091305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-32373cec-d3b0-447f-9911-40f027ab5fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043298 May 31 15:09:07.091855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 788/1585] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:08.103211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:08.104212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:08.110934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:08.111389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:08.112188 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:08.112628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:08.144587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1e52bdc0-97ab-4178-90d9-95652640551e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045680 May 31 15:09:08.145158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 798/1586] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:09.156289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:09.157209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:09.163795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:09.164496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:09.165261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:09.165692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:09.196814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-99c4c3f2-f22e-4d21-bc99-a8202578cf1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045064 May 31 15:09:09.197442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 789/1587] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:10.209470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:10.210401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:10.217372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:10.217863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:10.218727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:10.219162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:10.252314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-87226cfa-a519-47bd-a1a3-4d8982abe172 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046874 May 31 15:09:10.252897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 799/1588] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:11.263999 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:11.264962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:11.271601 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:11.272050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:11.272819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:11.273251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:11.303056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8683fb3a-2957-4bca-be48-aedf6a704742 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043620 May 31 15:09:11.303682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 790/1589] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:12.314825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:12.315740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:12.322325 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:12.322799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:12.324054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:12.324484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:12.354835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-950cc22b-a583-4288-9507-9299e0520d18 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043895 May 31 15:09:12.355402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 800/1590] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:13.366409 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:13.367358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:13.373789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:13.374239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:13.375039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:13.375473 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:13.574885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b0a52d3-fb8d-409e-8c1a-b3b5fbaed227 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.212312 May 31 15:09:13.575345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 791/1591] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:14.720720 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:14.721650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:14.727792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:14.728353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:14.729810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:14.730410 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:14.760505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-38b52a2c-119a-4e78-a929-e7d950bb2bf6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.178886 May 31 15:09:14.761070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 801/1592] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:15.772709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:15.773662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:15.780218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:15.780673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:15.781452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:15.781899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:15.811262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ed93c087-15b0-4a62-bb13-7ff4682ac4a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042686 May 31 15:09:15.811809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 792/1593] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:16.823665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:16.824590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:16.831142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:16.831587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:16.832356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:16.832795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:16.863413 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-65000296-fc3b-40c8-ae06-3809e03224fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044133 May 31 15:09:16.863978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 802/1594] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:17.875093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:17.876026 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:17.883770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:17.884233 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:17.885014 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:17.885457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:17.915220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ca67170d-171b-4709-b4c8-75e2441f1654 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044416 May 31 15:09:17.915763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 793/1595] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:18.927137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:18.928059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:18.935270 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:18.935725 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:18.936490 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:18.936937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:18.967450 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-685c3339-8553-4046-b0cb-50d3421fb9fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044309 May 31 15:09:18.968003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 803/1596] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:19.979091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:19.980299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:19.988216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:19.988678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:19.989464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:19.989908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:20.020313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d7e29c7e-a66d-49f8-a43d-9d14d825cd6d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045146 May 31 15:09:20.020898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 794/1597] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:21.032612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:21.033564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:21.040339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:21.040796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:21.041647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:21.042607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:21.072592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8f3d4e80-635f-41d2-a34b-567c9e6895f1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043849 May 31 15:09:21.073173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 804/1598] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:22.084174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:22.085169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:22.091706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:22.092166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:22.092950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:22.093397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:22.124220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ab4cc69b-4ce2-4348-99a4-ac010b82ddfe tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043886 May 31 15:09:22.125292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 795/1599] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:23.136614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:23.137547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:23.144204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:23.144729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:23.145522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:23.145958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:23.179211 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5ad54f37-1729-469e-af2e-91db0e63c7a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046575 May 31 15:09:23.180107 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 805/1600] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:24.190886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:24.192516 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:24.199760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:24.200216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:24.201006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:24.201479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:24.235314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-64388333-478f-4315-af6a-ecf13fa59ba1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048300 May 31 15:09:24.235888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 796/1601] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:25.248648 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:25.249589 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:25.256718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:25.256718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:25.257369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:25.257659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:25.288241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c5ddc65d-bb50-4470-a088-6eac349c4759 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043537 May 31 15:09:25.288792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 806/1602] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:26.299810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:26.300742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:26.307297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:26.307766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:26.308542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:26.308984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:26.340240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-760c1a46-c3f0-4b6d-a89d-c43b9fc3fd14 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044231 May 31 15:09:26.340702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 797/1603] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:27.253864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:09:27.254551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:09:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:09:27.351784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:27.352712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:27.359596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:27.360053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:27.360855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:27.361297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:27.391799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d24fd33a-80a6-4306-a4e7-9b95ab38e0cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043802 May 31 15:09:27.392284 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 807/1604] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:28.403712 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:28.404711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:28.411235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:28.411835 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:28.412624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:28.413268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:28.443456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a226c0c2-9fa3-4985-98a9-9b980577bfe1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043749 May 31 15:09:28.443876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 798/1605] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:29.455205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:29.457649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:29.463024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:29.464055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:29.464848 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:29.465612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:29.500689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bfe572f4-5def-4a75-ba15-1bf6bc6d90a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049456 May 31 15:09:29.501437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 808/1606] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:09:30.514243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:30.515192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:30.521349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:30.521797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:30.522560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:30.523153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:30.554003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ae031579-3c4b-4e6a-ab02-34bb2397c027 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044068 May 31 15:09:30.554567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 799/1607] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:31.565623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:31.566571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:31.575342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:31.575806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:31.577522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:31.578013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:31.618451 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6c6e5a1d-a62e-429e-b5bd-0b1b0f54ff11 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056889 May 31 15:09:31.619038 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 809/1608] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:32.631630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:32.632562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:32.635761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:32.647922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:32.647922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:32.647922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:32.647922 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:32.648576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:32.684443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bafa98e9-11c4-4508-94a8-72c6674263be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057917 May 31 15:09:32.684996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 800/1609] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:33.700983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:33.701914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:33.704438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:33.709812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:33.710264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:33.711734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:33.711734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:33.715061 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:09:33.744303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d6eb238c-d76b-4738-a63f-7b67ab76a30f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047210 May 31 15:09:33.744869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 810/1610] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:34.756011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:34.757109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:34.763913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:34.764374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:34.765156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:34.765592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:34.794724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4f5358e8-4882-4131-9940-42512a407482 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042702 May 31 15:09:34.795274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 801/1611] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:35.805418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:35.806328 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:35.813401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:35.813957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:35.814713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:35.815049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:35.845606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-be5c5f47-e20a-4c97-8da7-2369455df31d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044110 May 31 15:09:35.846156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 811/1612] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:36.857881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:36.858844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:36.865448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:36.865911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:36.866711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:36.867172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:36.896188 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4899f2ea-1fc7-4ead-948e-1b1f7af642ba tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042750 May 31 15:09:36.896727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 802/1613] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:37.908619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:37.909562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:37.916222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:37.917165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:37.917935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:37.918375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:37.948265 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ddc5e039-9596-491e-b8b8-17fe5e75eea8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043568 May 31 15:09:37.948814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 812/1614] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:38.958812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:38.959736 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:38.966524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:38.967009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:38.967789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:38.968227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:38.997600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0047282f-e354-48d7-9be3-008eb578a840 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042734 May 31 15:09:38.998152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 803/1615] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:40.009139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:40.010587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:40.017116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:40.017572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:40.018348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:40.018819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:40.049982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-291ec8c1-e132-48ce-8549-c091d06acc8d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044758 May 31 15:09:40.050540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 813/1616] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:41.061256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:41.062168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:41.068646 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:41.069096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:41.069855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:41.070332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:41.101915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-39a96717-fac3-4cd8-8ed3-949622424cdc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044222 May 31 15:09:41.102482 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 804/1617] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:42.113331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:42.114253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:42.120825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:42.121286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:42.122063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:42.122504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:42.153276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e6e06ab0-57cb-4f35-874f-160e64da175d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043758 May 31 15:09:42.153815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 814/1618] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:43.169890 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:43.171117 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:43.181508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:43.182706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:43.184053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:43.184819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:43.232175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aa68e030-ba88-4b1a-a776-7ca6e166c4fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069919 May 31 15:09:43.232728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 805/1619] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:44.244083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:44.245491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:44.251745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:44.252196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:44.253592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:44.254037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:44.283820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-95379492-5b71-4204-bb93-6b5961bebb98 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043852 May 31 15:09:44.284376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 815/1620] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:45.295833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:45.296767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:45.303205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:45.303778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:45.304445 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:45.304888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:45.334740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4c6c4b65-00f9-4b1a-bd5f-1ca3c3596683 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043211 May 31 15:09:45.335297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 806/1621] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:09:46.345867 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:46.346835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:46.353230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:46.353775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:46.354547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:46.355016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:46.387707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-18dd6da0-c706-4932-b65b-50fc3cf51e25 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045609 May 31 15:09:46.388219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 816/1622] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:47.399254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:47.400181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:47.406945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:47.407399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:47.408171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:47.408814 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:47.438982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f63dd358-b5d5-489c-ba57-47a4e249b6e2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043507 May 31 15:09:47.439538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 807/1623] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:48.450072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:48.451071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:48.457513 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:48.458037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:48.458813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:48.459214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:48.489366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-10e34c1c-cec4-4a37-a7fc-690478ae0c65 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043970 May 31 15:09:48.489925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 817/1624] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:49.501702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:49.502692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:49.511820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:49.512492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:49.513264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:49.513704 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:49.544944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b9476026-ca2c-4224-b5c9-aec624811a89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047418 May 31 15:09:49.545507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 808/1625] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:50.557499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:50.558419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:50.564955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:50.565408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:50.566234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:50.566612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:50.595868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f47c0305-c25e-41e1-ba34-541dd24a1298 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042976 May 31 15:09:50.596439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 818/1626] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:51.606576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:51.607530 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:51.614052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:51.614533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:51.615319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:51.615770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:51.649557 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-858847f3-ab1d-458f-949c-6e48f701011a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046864 May 31 15:09:51.650127 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 809/1627] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:52.660730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:52.661659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:52.668969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:52.669423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:52.670184 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:52.670624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:52.700804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3eec6a7d-5bb5-4864-8fae-25eb15eb3bf0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043953 May 31 15:09:52.701320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 819/1628] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:53.714211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:53.715178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:53.721680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:53.722140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:53.722958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:53.723405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:53.753940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e97b905d-590e-4f7e-8a5c-dbee3d639fcf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045447 May 31 15:09:53.754504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 810/1629] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:54.766077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:54.766950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:54.773529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:54.773983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:54.774780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:54.775222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:54.805227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5909678a-172f-4282-97f3-94bee43d9c78 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043109 May 31 15:09:54.805787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 820/1630] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:55.817354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:55.818313 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:55.825009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:55.825465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:55.826244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:55.826724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:55.857197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-32af7e70-79ee-4458-8cf0-e21f76ae6bc8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043722 May 31 15:09:55.857760 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 811/1631] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:56.869421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:56.870380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:56.876820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:56.877269 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:56.878064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:56.878504 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:56.908962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-10bcfbb2-ec92-49ff-8d4b-5a2ef3955836 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044025 May 31 15:09:56.909534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 821/1632] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:57.920466 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:57.921394 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:57.927954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:57.928419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:57.929196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:57.929647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:57.959972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1eff52bc-96d5-47cd-8fc7-06e2c598e2c3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043414 May 31 15:09:57.960532 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 812/1633] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:09:58.971674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:09:58.972598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:09:58.979547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:58.980001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:58.980758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:09:58.981197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:09:59.010973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-72bbcd92-d334-4701-8c6d-b709a79e07d3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043188 May 31 15:09:59.015239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 822/1634] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:09:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:00.023150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:00.024085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:00.031207 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:00.031663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:00.032442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:00.032882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:00.064001 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ca64fcd6-a8c9-4f57-a86d-9225232e7f27 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044839 May 31 15:10:00.064563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 813/1635] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:01.076521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:01.077452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:01.083977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:01.084446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:01.085196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:01.085636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:01.115444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b2732d08-2823-4a1b-b2c0-5d2bf25eb6ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043346 May 31 15:10:01.116009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 823/1636] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:02.127326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:02.128239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:02.134917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:02.135319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:02.136099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:02.136544 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:02.167013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-48ce1d24-c932-4ead-b968-76a9b9de0bbb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043628 May 31 15:10:02.167580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 814/1637] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:03.178500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:03.179551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:03.186432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:03.186994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:03.187840 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:03.188350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:03.221483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5fe9fd4e-79af-4340-a61a-193805e6bcd6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046898 May 31 15:10:03.222669 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 824/1638] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:04.233551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:04.234397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:04.236833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:04.242236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:04.242723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:04.243504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:04.243949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:04.247713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:04.274287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c3eedfac-69f1-40b9-9b84-e555e6db5fa2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044769 May 31 15:10:04.274892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 815/1639] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:05.286712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:05.287636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:05.290279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:05.295670 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:05.296127 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:05.296892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:05.297336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:05.301098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:05.327532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6337ecb1-2680-4a1c-95bf-eceafd78bc9b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044834 May 31 15:10:05.328118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 825/1640] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:06.339727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:06.340640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:06.347779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:06.348226 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:06.348988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:06.349433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:06.388192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a5500bda-ce36-45e0-80cb-a7c5ef4de7a4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052349 May 31 15:10:06.389162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 816/1641] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:07.401559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:07.402404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:07.409018 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:07.409471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:07.410239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:07.410702 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:07.440958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b1a0a5a8-14ee-4b95-a0d6-e6f883f954e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043483 May 31 15:10:07.441812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 826/1642] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:08.453076 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:08.454031 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:08.461392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:08.461850 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:08.462636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:08.463756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:08.493399 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a2653eaf-285c-4523-a3be-54caa9390f05 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044302 May 31 15:10:08.493963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 817/1643] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:09.506169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:09.507015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:09.512998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:09.513448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:09.514199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:09.514636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:09.545506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-73c762f6-200f-4998-9fb7-a369d107a3e0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044033 May 31 15:10:09.546074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 827/1644] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:10.557964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:10.558943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:10.565434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:10.565900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:10.566728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:10.567180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:10.596565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e8a8acdf-24fb-4be6-b1b7-8e699582742b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043087 May 31 15:10:10.597120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 818/1645] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:11.607985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:11.608907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:11.615474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:11.615952 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:11.616712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:11.617153 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:11.648605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-28991ecd-b0e5-46d5-a2b5-22368d1add82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044546 May 31 15:10:11.649207 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 828/1646] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:12.660317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:12.661244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:12.668658 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:12.669112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:12.669882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:12.670324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:12.698680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a5872d10-a51b-4868-b6fd-af6205841319 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042279 May 31 15:10:12.699218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 819/1647] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:10:13.710268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:13.711223 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:13.717684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:13.718140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:13.718934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:13.719375 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:13.752623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a30b10b3-7f98-407e-9bf2-d6c01d7d06b0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046329 May 31 15:10:13.753295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 829/1648] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:14.765844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:14.766723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:14.772815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:14.773262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:14.774033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:14.774480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:14.804273 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2c2008d6-3265-4b33-ac95-ee2152210517 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043316 May 31 15:10:14.804822 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 820/1649] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:15.817196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:15.818109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:15.824176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:15.824615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:15.825368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:15.825795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:15.855334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c8f71dc4-7f10-4a91-b0bf-b3b4352dc455 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042196 May 31 15:10:15.855811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 830/1650] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:16.866942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:16.867870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:16.875051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:16.875517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:16.876318 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:16.876764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:16.906128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4c6d3214-2075-433c-b5fe-0159304aeab8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043182 May 31 15:10:16.906783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 821/1651] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:17.917765 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:17.918717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:17.925313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:17.925631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:17.926389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:17.926856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:17.957331 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-df881cbf-7f4d-4dba-8ce0-d542f02fd29e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043853 May 31 15:10:17.957892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 831/1652] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:18.968923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:18.969842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:18.976357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:18.976808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:18.977569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:18.978008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:19.007182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0a203c0a-7aee-4598-b700-196510c6b3a5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042257 May 31 15:10:19.007791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 822/1653] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:20.019601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:20.020512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:20.027110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:20.027561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:20.028326 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:20.028759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:20.058793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-701afd08-eade-455f-a8a3-6b996ee3edb9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043025 May 31 15:10:20.059274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 832/1654] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:21.070216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:21.071157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:21.078251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:21.078734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:21.079499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:21.079981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:21.108404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-51f1a737-e847-4b0d-8147-5cb060c0ac53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042128 May 31 15:10:21.108949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 823/1655] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:22.120501 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:22.121421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:22.130330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:22.131244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:22.131576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:22.132011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:22.163557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3895d190-0d4a-4d10-b560-4cb992c6a1bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046673 May 31 15:10:22.164047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 833/1656] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:23.175695 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:23.176625 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:23.183463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:23.183923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:23.184705 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:23.185174 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:23.215599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-849d545d-28a5-444c-abdd-dd9f8862ffd3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044374 May 31 15:10:23.216087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 824/1657] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:10:24.227524 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:24.228545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:24.235045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:24.235498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:24.236295 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:24.236738 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:24.266348 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e5e1c49-e9ca-4f67-9ddf-4be97da3dd3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042695 May 31 15:10:24.266856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 834/1658] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:25.278049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:25.279009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:25.285577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:25.286041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:25.286841 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:25.287288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:25.318301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-959031ea-25de-442a-9db3-6313fcc03190 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044219 May 31 15:10:25.318782 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 825/1659] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:26.329538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:26.330376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:26.337027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:26.337508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:26.338272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:26.338735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:26.367426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3db6b9f-c434-4fb8-9f1b-9316de781235 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041946 May 31 15:10:26.367984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 835/1660] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:27.378638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:27.379606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:27.386363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:27.386795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:27.387567 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:27.388015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:27.417874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b1e584a-ee7a-4591-b7d0-7dd919bf8902 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043108 May 31 15:10:27.418424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 826/1661] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:28.429565 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:28.430403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:28.437403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:28.437856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:28.438616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:28.439086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:28.468470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2a479ef5-79cc-42f8-939d-4e3ceb69e826 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042940 May 31 15:10:28.469038 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 836/1662] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:29.481640 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:29.482669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:29.489840 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:29.491033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:29.491839 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:29.492323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:29.528108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c641f5de-b3d5-4ecf-b570-ff52a3fc0fac tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051601 May 31 15:10:29.528686 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 827/1663] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:30.540969 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:30.541888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:30.548529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:30.548981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:30.549746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:30.550183 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:30.580083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d3f1d1d8-a145-4a2d-b30b-c164b4e1dc3a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043836 May 31 15:10:30.580647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 837/1664] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:31.592041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:31.592885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:31.599460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:31.599916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:31.600677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:31.601120 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:31.629951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cce40057-1cdd-4ea5-a926-2bd934d124c6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042068 May 31 15:10:31.630489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 828/1665] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:32.641651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:32.642480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:32.648892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:32.649333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:32.650747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:32.651176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:32.679676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0937df73-3a54-45d2-97c7-9fcc78277044 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042111 May 31 15:10:32.680218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 838/1666] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:33.691911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:33.692750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:33.699496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:33.700105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:33.700738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:33.701175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:33.731202 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-82d6c28c-e1b2-42ea-bb68-de5a3d91c28d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043804 May 31 15:10:33.731751 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 829/1667] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:34.744101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:34.745042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:34.751759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:34.752202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:34.752964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:34.753400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:34.781826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-90899809-5ec0-48dc-99b0-fabc08e1bf80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042846 May 31 15:10:34.782550 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 839/1668] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:35.794265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:35.795160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:35.797648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:35.802974 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:35.803423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:35.804194 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:35.804637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:35.808934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:35.835052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f12237f0-37ca-48d8-94c5-4385a4638c3e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044874 May 31 15:10:35.835627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 830/1669] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:36.847058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:36.847898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:36.850254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:36.856581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:36.857037 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:36.857803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:36.858241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:36.860618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:10:36.888426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5a18906b-97ea-4e27-a607-fec3b9423534 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045583 May 31 15:10:36.889000 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 840/1670] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:37.900769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:37.901599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:37.908266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:37.908719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:37.909478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:37.909915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:37.938687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9ef08eea-856f-412b-b8de-51b77bac559b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042526 May 31 15:10:37.939224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 831/1671] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:38.950218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:38.951171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:38.957904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:38.958352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:38.959138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:38.959571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:38.989369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-71656d19-a2fb-4078-ab90-1bd3008d5fbc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043113 May 31 15:10:38.989927 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 841/1672] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:40.001224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:40.002063 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:40.008636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:40.009090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:40.009870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:40.010338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:40.040596 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1081f878-e319-4b72-ad80-c9b5485e17a1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042881 May 31 15:10:40.041147 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 832/1673] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:41.052510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:41.053384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:41.060398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:41.060858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:41.061623 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:41.062065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:41.091538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-956304fe-a384-461e-9faf-06af2fd11fc2 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043088 May 31 15:10:41.092133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 842/1674] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:42.103433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:42.104881 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:42.111397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:42.111854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:42.112618 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:42.113061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:42.144338 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-14a6f56d-2303-472d-8c36-5e6b7c0033cc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044987 May 31 15:10:42.144911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 833/1675] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:43.156662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:43.157714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:43.164439 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:43.164882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:43.165653 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:43.166091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:43.195541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-deaaa9a1-ffd5-4ce2-b381-4fa4e34c88fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042826 May 31 15:10:43.196115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 843/1676] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:44.208328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:44.209165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:44.215939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:44.216390 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:44.217161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:44.217603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:44.247672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-79e4bbbf-8681-446e-a1f4-732cdbd80bd5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043397 May 31 15:10:44.248225 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 834/1677] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:45.259916 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:45.260760 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:45.266924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:45.267378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:45.268155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:45.268595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:45.299735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a5c66852-d3f6-4668-aaf2-fabee21c729f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044251 May 31 15:10:45.300316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 844/1678] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:46.312082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:46.312926 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:46.319549 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:46.320004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:46.320774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:46.321216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:46.350692 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c67e792e-2bb6-4c8d-8a17-fbe26c1ced80 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042658 May 31 15:10:46.351243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 835/1679] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:47.362353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:47.363306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:47.370363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:47.370857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:47.371616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:47.372053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:47.401796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-883520a8-06c4-4141-be0f-da37efc6d270 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043335 May 31 15:10:47.402355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 845/1680] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:48.413897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:48.414859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:48.421486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:48.421946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:48.422747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:48.423197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:48.452348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24be05c2-443c-4011-88cd-04b71d6b2af8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042717 May 31 15:10:48.452900 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 836/1681] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:10:49.464650 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:49.465480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:49.472229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:49.472680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:49.473435 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:49.473873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:49.513150 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2bfb90e4-cbf3-4f40-912d-2ff957a5bd84 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052939 May 31 15:10:49.513897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 846/1682] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:50.525164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:50.531312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:50.538160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:50.538615 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:50.539417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:50.539858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:50.570697 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-60efc9ab-782a-498f-873f-e5d4169ac07e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049514 May 31 15:10:50.571249 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 837/1683] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:51.582482 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:51.583382 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:51.589884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:51.590330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:51.591116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:51.591552 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:51.620638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ee91ec4c-b837-4d7d-baa1-8ba4a69dcb3c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042254 May 31 15:10:51.621190 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 847/1684] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:52.632231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:52.633178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:52.640190 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:52.640645 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:52.641407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:52.641855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:52.671310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d24de064-acdb-4033-8745-8f8ebcabb0c9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043020 May 31 15:10:52.671856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 838/1685] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:53.681947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:53.682898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:53.689346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:53.689796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:53.690557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:53.691020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:53.721422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e53b2503-7eee-4c6c-b57c-08ecb6873b82 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043451 May 31 15:10:53.721974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 848/1686] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:54.733767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:54.734616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:54.741168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:54.741650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:54.742412 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:54.742891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:54.771637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e96afa3a-fd26-4265-875d-31013beb4585 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041982 May 31 15:10:54.772175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 839/1687] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:55.784372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:55.785215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:55.792474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:55.792930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:55.793735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:55.794179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:55.824638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-57034e18-7bd4-484e-94ef-8293676a2c33 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044329 May 31 15:10:55.825209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 849/1688] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:56.836407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:56.837778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:56.844472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:56.844924 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:56.845688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:56.846122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:56.875175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4e8628c1-7233-4eef-b2ec-c7446a199393 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042766 May 31 15:10:56.875715 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 840/1689] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:57.886571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:57.887569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:57.894161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:57.894608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:57.895409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:57.895843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:57.925934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2ed2fc59-b40b-4c50-89b5-db26505089bc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043852 May 31 15:10:57.926494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 850/1690] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:58.938150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:58.939087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:58.945528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:58.945975 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:58.946767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:58.947203 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:58.976685 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aa673e04-e43a-4b66-afd3-e3799368ac00 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042501 May 31 15:10:58.977228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 841/1691] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:10:59.988290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:10:59.989218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:10:59.995659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:59.996113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:10:59.996877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:10:59.997313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:00.027029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3eb2ebc-4c7e-4089-a944-15309aa875df tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042629 May 31 15:11:00.027607 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 851/1692] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:10:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:01.038600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:01.039460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:01.046369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:01.046868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:01.047631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:01.048065 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:01.077089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7d699273-7b5a-4177-aad8-714a95449e8f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043007 May 31 15:11:01.077630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 842/1693] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:02.089427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:02.090301 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:02.096854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:02.097311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:02.098114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:02.098555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:02.129568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7260a8d6-e212-462c-b726-361e599ddf2b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044623 May 31 15:11:02.130159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 852/1694] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:03.141384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:03.142322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:03.148859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:03.149321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:03.150111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:03.150561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:03.182350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-834e3614-5084-4f4b-8670-e5bf474af063 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044900 May 31 15:11:03.183633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 843/1695] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:04.194764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:04.195699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:04.204075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:04.204821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:04.206117 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:04.206894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:04.239346 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2af39ca8-f800-47da-85c3-56eac21bb827 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048834 May 31 15:11:04.239917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 853/1696] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:05.251185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:05.252100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:05.258709 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:05.259164 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:05.259929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:05.260367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:05.289550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e37e57bc-c02c-4211-88ef-84e5712c5a68 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042298 May 31 15:11:05.290093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 844/1697] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:06.302174 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:06.303027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:06.311124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:06.311737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:06.312893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:06.313705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:06.346824 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dbd73a6c-5523-425a-852f-2520300148e8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048635 May 31 15:11:06.347401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 854/1698] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:07.358100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:07.359061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:07.361500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:07.367042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:07.367496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:07.368268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:07.368714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:07.371824 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:07.400056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cbb5687c-a064-4c45-9acb-39148d627c5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045877 May 31 15:11:07.400610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 845/1699] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:08.411708 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:08.412883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:08.415312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:08.420663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:08.421112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:08.421875 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:08.422572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:08.425338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:08.453852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fee2b1f9-3aff-468c-8d69-cf7cc5f5c222 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046049 May 31 15:11:08.454619 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 855/1700] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:09.466152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:09.467105 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:09.473593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:09.474051 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:09.474874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:09.475304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:09.511198 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-15be9802-bdb4-48aa-ba4b-c35b0460a5fd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049432 May 31 15:11:09.511763 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 846/1701] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:10.521934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:10.522885 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:10.529767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:10.530220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:10.531070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:10.531456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:10.561173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-59135daf-5cb6-408d-93cb-977c4be9e0b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043153 May 31 15:11:10.561729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 856/1702] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:11.573015 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:11.573857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:11.580949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:11.581430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:11.582200 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:11.582636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:11.612099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-29e4229c-742a-4467-abb1-f8ae6ff1ca89 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043124 May 31 15:11:11.612672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 847/1703] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:12.623819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:12.624743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:12.631297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:12.631748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:12.632511 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:12.632951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:12.662332 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d211877a-b2a1-459f-8759-51784790554a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042326 May 31 15:11:12.662920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 857/1704] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:13.674925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:13.675854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:13.681885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:13.682343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:13.683154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:13.683603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:13.712898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e5015c9c-cddc-4ecb-b011-e5425b7d684c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042199 May 31 15:11:13.713448 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 848/1705] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:14.724663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:14.725594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:14.732544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:14.732999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:14.733796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:14.734240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:14.763639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0e37507c-6575-43c1-8c23-c670ba71c3e9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042891 May 31 15:11:14.764195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 858/1706] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:15.775629 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:15.776542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:15.783022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:15.783479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:15.784238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:15.784675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:15.813781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38fc502c-6cd6-4ee4-8975-d879d1b1cba4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042191 May 31 15:11:15.814331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 849/1707] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:16.826576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:16.827445 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:16.833925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:16.834382 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:16.835169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:16.835615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:16.864950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4dddc1e2-3bbd-4a64-916e-9093ffb97a5f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042945 May 31 15:11:16.865505 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 859/1708] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:17.876594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:17.877520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:17.884103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:17.884558 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:17.885320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:17.885761 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:17.914593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cfa08bef-0d90-4c71-831b-20c862029ae5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042021 May 31 15:11:17.915166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 850/1709] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:18.925749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:18.926679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:18.933251 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:18.933700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:18.935145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:18.935577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:18.964500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2e9b88f8-897a-4b55-9bc8-679e02d7b2af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042749 May 31 15:11:18.965049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 860/1710] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:19.976321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:19.977242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:19.984290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:19.984746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:19.985514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:19.985954 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:20.017278 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-172e52d3-f922-4432-acac-d36fe718baa1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044839 May 31 15:11:20.017846 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 851/1711] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:21.029767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:21.030704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:21.037635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:21.038080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:21.038879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:21.039316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:21.074123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0733f81e-cc2e-4b10-a6a1-36d1c3d57a48 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048521 May 31 15:11:21.075493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 861/1712] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:22.087237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:22.088074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:22.094476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:22.094960 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:22.095724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:22.096167 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:22.126346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-98e3026c-c89b-48ca-a382-d4f088ff6197 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043117 May 31 15:11:22.126930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 852/1713] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:23.138137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:23.139092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:23.145541 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:23.145993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:23.146797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:23.147235 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:23.176558 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-64ce98e5-372c-4b26-8d4a-b45e9fa82619 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043015 May 31 15:11:23.177130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 862/1714] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:24.188993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:24.189923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:24.198099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:24.198562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:24.199381 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:24.199885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:24.231182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-768c4a9a-8d56-4208-b9e3-cd4329f1be07 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046179 May 31 15:11:24.231737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 853/1715] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:25.242941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:25.243901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:25.250387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:25.250884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:25.251655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:25.252092 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:25.281543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4bb2e093-a59a-4889-a8ca-eee0cb326b7f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042626 May 31 15:11:25.282126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 863/1716] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:25.698158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-06a26569-a50a-4ded-805d-3a6f7aeab4b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] Calling method '.version_select at 0x7f8dc892fb80>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:25.721094 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-06a26569-a50a-4ded-805d-3a6f7aeab4b7 tempest-TestVolumeBootPattern-180337677 tempest-TestVolumeBootPattern-180337677-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514972060" status: 202 len: 0 microversion: 2.1 time: 0.026692 May 31 15:11:25.722101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 854/1717] 10.222.0.67 () {58 vars in 1262 bytes} [Tue May 31 15:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514972060 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:11:25.904032 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:25.904538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:25.910692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:25.911146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:25.912158 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:25.912597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:25.938586 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:11:26.022108 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-42fa8150-5ee6-4e4f-b164-c6fde2ad2923 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 204 len: 0 microversion: 2.1 time: 0.122261 May 31 15:11:26.026528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 864/1718] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:11:25 2022] DELETE /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:11:26.031650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:26.032271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:26.039074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:26.039523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:26.040326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:26.040769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:26.294355 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:26.295409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:26.301789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:26.302242 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:26.303044 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:26.303480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:26.318617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:26.327738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4e8b104c-574e-4ea6-b6df-307fdeab62b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1682 microversion: 2.1 time: 0.300179 May 31 15:11:26.337827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 855/1719] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:26 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:26.338049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-52b28237-67ec-4935-af65-9d42eeb8ad06 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045067 May 31 15:11:26.338049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 865/1720] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:27.346952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:27.347581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:27.347965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:27.348086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:27.355663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:27.356503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:27.356696 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:27.357343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:27.357502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:27.357886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:27.358617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:27.359263 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:27.393817 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4084ea6c-1d3e-4e09-8c08-c00193059b53 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050606 May 31 15:11:27.398258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 866/1721] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:27.462158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:27.470372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2a938903-fc1f-4430-b3af-939c96a439f0 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 200 len: 1615 microversion: 2.1 time: 0.127424 May 31 15:11:27.470995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 856/1722] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:27 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 1615 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:27.823994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-fe86a453-d03f-4f07-8fe4-008ae3086c66 req-cada53a9-8ab3-4826-b8f9-bf149cc5718d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3f067e-4a88-4f16-aca3-284ecab21200", "name": "network-vif-deleted", "tag": "318ba0f3-9cd9-4159-93a6-841c62d831b6"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:27.833717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-fe86a453-d03f-4f07-8fe4-008ae3086c66 req-cada53a9-8ab3-4826-b8f9-bf149cc5718d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:27.836142 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-fe86a453-d03f-4f07-8fe4-008ae3086c66 req-cada53a9-8ab3-4826-b8f9-bf149cc5718d service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:27.865617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-fe86a453-d03f-4f07-8fe4-008ae3086c66 req-cada53a9-8ab3-4826-b8f9-bf149cc5718d service nova] Creating event network-vif-deleted:318ba0f3-9cd9-4159-93a6-841c62d831b6 for instance 3d3f067e-4a88-4f16-aca3-284ecab21200 on hv-cinder-83979 May 31 15:11:27.882051 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-fe86a453-d03f-4f07-8fe4-008ae3086c66 req-cada53a9-8ab3-4826-b8f9-bf149cc5718d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145133 May 31 15:11:27.883858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 867/1723] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:28.408805 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:28.411095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:28.421969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:28.423392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:28.424643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:28.425228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:28.467156 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-db0c3a01-fb76-49c8-8f2f-607f49030ef4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064976 May 31 15:11:28.468045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 857/1724] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:28.490610 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:28.492002 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:28.500474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:28.500934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:28.501928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:28.502550 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:28.518762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 HTTP/1.1 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:11:28.520792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:11:28.522384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '3d3f067e-4a88-4f16-aca3-284ecab21200'} May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:11:28.523364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:11:28.529191 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:11:28.530622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:11:28.530622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2730da98-f7b5-4ea9-b70e-b9d807b99a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 404 len: 111 microversion: 2.1 time: 0.037453 May 31 15:11:28.530622 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 868/1725] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:28 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:11:28.533270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c5153d7e-975e-4234-a927-e2849b3b3924 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '.version_select at 0x7f8dc878aaf0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:28.563374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c5153d7e-975e-4234-a927-e2849b3b3924 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459060482" status: 202 len: 0 microversion: 2.1 time: 0.033919 May 31 15:11:28.565020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 858/1726] 10.222.0.67 () {58 vars in 1220 bytes} [Tue May 31 15:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459060482 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:11:29.454055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-be483e26-5800-49bf-a361-055e560f1657 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: .version_select at 0x7f8dbf4e7040>, body: {"keypair": {"name": "tempest-keypair-2067420576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG32lF7F8+w8BUC5g0xiqPh21XnrZsWePkk8aX0bBaTl25SWx+o45gFfQCyjet3qBP7o4NBNdfboen5KXALn0FEZebpG0BIhZi55ShcWgNaVb21WLvYEwmyHCXMO2SEqPg=="}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:29.469516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-be483e26-5800-49bf-a361-055e560f1657 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:11:29.473467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-be483e26-5800-49bf-a361-055e560f1657 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:11:29.479529 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:29.480452 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:29.494719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:29.495244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:29.496089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:29.496580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:29.529432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-be483e26-5800-49bf-a361-055e560f1657 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079980 May 31 15:11:29.530444 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 869/1727] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 15:11:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:29.595612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eb41a7fc-28a9-48ba-b291-3b2f38246644 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.119813 May 31 15:11:29.597158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 859/1728] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:30.611070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:30.614253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:30.624630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:30.625356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:30.626546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:30.627205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:30.662267 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fb37babd-dade-42b7-846d-b16ff46c12ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057485 May 31 15:11:30.663140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 870/1729] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:31.294235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1337841237", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5750f2c5-2b61-4d8b-8c4e-2d47f35308a2"}], "security_groups": [{"name": "tempest-securitygroup--1402855636"}], "key_name": "tempest-keypair-2067420576", "user_data": "}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:31.454764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] validate_networks() for [('5750f2c5-2b61-4d8b-8c4e-2d47f35308a2', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:11:31.674459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:31.676427 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:31.685527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:31.686217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:31.687354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:31.688301 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:31.733813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d5859e9e-a996-4e2c-b56d-e570fe8321d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064296 May 31 15:11:31.734868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 871/1730] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:31.936311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:11:31.937029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:11:31.937591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:11:31.938107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:11:31.938607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:11:31.951599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:31.952342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:31.953388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:31.954046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:31.975742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:11:31.982853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:11:31.997729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:11:32.000641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:11:32.062293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-357af633-c538-4155-a3fd-e44be300d1a4 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.773155 May 31 15:11:32.063962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 860/1731] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:11:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:11:32.073534 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-53e718c8-bed8-46c2-9c56-e66c5172868b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:32.074227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-53e718c8-bed8-46c2-9c56-e66c5172868b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:32.225011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-53e718c8-bed8-46c2-9c56-e66c5172868b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:32.233166 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-53e718c8-bed8-46c2-9c56-e66c5172868b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1242 microversion: 2.1 time: 0.163418 May 31 15:11:32.233858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 872/1732] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:32 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:32.746905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:32.747896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:32.755217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:32.755781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:32.757006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:32.757575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:32.792934 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-8e4a6f4d-54df-4fac-aac3-1a8c421178d5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051283 May 31 15:11:32.793718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 861/1733] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:33.252133 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:33.260525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:33.288859 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:33.292233 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:33.294101 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:33.294747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:33.313851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:33.373963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:33.381464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-03fbdba8-abaf-4eb7-8dc9-85d90e67e9b2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1300 microversion: 2.1 time: 0.135848 May 31 15:11:33.382038 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 873/1734] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:33 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:33.804892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:33.806740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:33.813155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:33.813614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:33.814398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:33.814870 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:33.847050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ca0d992f-a6b6-4f86-92e1-9e69e36b5b92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046555 May 31 15:11:33.847879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 862/1735] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:34.399132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:34.399890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:34.406564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:34.407268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:34.412156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:34.412156 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:34.617935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:34.645264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6d051618-cca9-4189-9d5b-067abf861a04 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.249897 May 31 15:11:34.645878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 874/1736] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:34 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:11:34.859945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:34.861661 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:34.868683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:34.869459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:34.870260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:34.870792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:34.903713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-644b17da-daa2-4dc2-96aa-736ba79f05af tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048292 May 31 15:11:34.904210 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 863/1737] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:35.082494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-64b51217-a968-45a1-b56d-e8f59818d96a req-e67eb9ba-82fa-40b8-b498-987684c5a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1632c3-9777-4687-85df-676c6d678852", "tag": "64e2313a-18e9-4117-8b59-c959e9457198"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:35.097426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-64b51217-a968-45a1-b56d-e8f59818d96a req-e67eb9ba-82fa-40b8-b498-987684c5a4ec service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:35.097970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-64b51217-a968-45a1-b56d-e8f59818d96a req-e67eb9ba-82fa-40b8-b498-987684c5a4ec service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:35.117471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-64b51217-a968-45a1-b56d-e8f59818d96a req-e67eb9ba-82fa-40b8-b498-987684c5a4ec service nova] Creating event network-changed:64e2313a-18e9-4117-8b59-c959e9457198 for instance 4c1632c3-9777-4687-85df-676c6d678852 on hv-cinder-83979 May 31 15:11:35.124866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-64b51217-a968-45a1-b56d-e8f59818d96a req-e67eb9ba-82fa-40b8-b498-987684c5a4ec service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045912 May 31 15:11:35.125776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 875/1738] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:35.667169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:35.667783 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:35.673824 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:35.674268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:35.675057 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:35.675491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:35.690991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:35.811449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:35.818851 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-52cc0f60-e4ef-4bc8-89fd-1030ca8ab58f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.155590 May 31 15:11:35.819423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 864/1739] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:35 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:35.916676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:35.917674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:35.926311 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:35.926789 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:35.927563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:35.927996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:35.959320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fd429ee2-c123-44bb-b7bb-e7577900a78d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047687 May 31 15:11:35.960352 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 876/1740] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:36.836498 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:36.837030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:36.843522 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:36.843981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:36.844754 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:36.845201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:36.972085 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:36.973114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:36.976842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:36.979963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:36.980484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:36.981323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:36.981828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:36.984503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f6ac8438-5970-48eb-9b0b-1bbaaadf97ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.151973 May 31 15:11:36.985075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 865/1741] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:36 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:37.016465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8e192e2b-fe07-4ba6-b776-4cfcbb9543b6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048445 May 31 15:11:37.017027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 877/1742] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:38.001407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:38.002023 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:38.004388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:38.009986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:38.010447 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:38.011271 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:38.011742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:38.030049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:38.031771 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:38.038964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:38.039419 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:38.040205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:38.040640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:38.074931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-21afabf7-375e-4f20-8e33-59436f621887 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049809 May 31 15:11:38.078898 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 878/1743] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:38.157413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:38.165240 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-677432a6-0b12-4af8-9583-fdf7c1a207b1 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.167639 May 31 15:11:38.165813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 866/1744] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:37 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:39.086931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:39.087854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:39.090868 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:39.096421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:39.096879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:39.097649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:39.098089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:39.130433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4c8feff6-8b31-4782-83c5-f570f4a2a705 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047511 May 31 15:11:39.131323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 879/1745] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:39.182610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:39.183256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:39.189715 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:39.190170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:39.191008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:39.191417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:39.318616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:39.326751 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f11dcc41-f011-41d4-805c-48d5e1bd5109 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.147881 May 31 15:11:39.327317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 867/1746] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:39 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:40.141908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:40.142903 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:40.149545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:40.149998 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:40.150801 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:40.151245 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:40.181932 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-87e4b7f6-a8d7-417c-ae14-c83380844096 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044070 May 31 15:11:40.182523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 880/1747] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:40.344161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:40.345443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:40.352254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:40.352779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:40.353562 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:40.354002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:40.489480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:40.497577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dfb0a10e-ef1e-4508-be80-2b38145616df tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.157784 May 31 15:11:40.498150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 868/1748] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:40 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:41.193754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:41.194734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:41.202747 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:41.203204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:41.203999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:41.204452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:41.238178 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-923d06fb-9315-4366-9502-c1bfb71d5a66 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048398 May 31 15:11:41.238816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 881/1749] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:41.514450 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:41.515073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:41.521868 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:41.522345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:41.523155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:41.523605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:41.666444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:41.674611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-267e2ece-d39a-49e2-a58d-a90844da2ee3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.164249 May 31 15:11:41.675213 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 869/1750] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:41 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:41.983943 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-74aadadb-38aa-4d2d-b558-33379a602bc6 req-ae09546d-52db-4440-915a-9440ac4f134b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1632c3-9777-4687-85df-676c6d678852", "name": "network-vif-plugged", "status": "completed", "tag": "64e2313a-18e9-4117-8b59-c959e9457198"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:41.991982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-74aadadb-38aa-4d2d-b558-33379a602bc6 req-ae09546d-52db-4440-915a-9440ac4f134b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:41.992428 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-74aadadb-38aa-4d2d-b558-33379a602bc6 req-ae09546d-52db-4440-915a-9440ac4f134b service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:42.003264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-74aadadb-38aa-4d2d-b558-33379a602bc6 req-ae09546d-52db-4440-915a-9440ac4f134b service nova] Creating event network-vif-plugged:64e2313a-18e9-4117-8b59-c959e9457198 for instance 4c1632c3-9777-4687-85df-676c6d678852 on hv-cinder-83979 May 31 15:11:42.008456 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-74aadadb-38aa-4d2d-b558-33379a602bc6 req-ae09546d-52db-4440-915a-9440ac4f134b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210150 May 31 15:11:42.009070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 882/1751] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:42.249555 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:42.250513 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:42.252410 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:42.253724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=6 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:42.259961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:42.260546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:42.261845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:42.262291 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:42.296440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e50c1216-dbc1-4523-8ba0-222eb4020a92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050855 May 31 15:11:42.296998 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 870/1752] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:42.688959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:42.693139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:42.693830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:42.701017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:42.701466 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:42.702255 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:42.702721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:42.835855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:42.843377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-770e5e5c-833e-451f-8ac0-ff24d7bd0d0a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.155787 May 31 15:11:42.843945 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 883/1753] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:42 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:43.308714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:43.309681 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:43.316698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:43.317157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:43.317959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:43.318408 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:43.352082 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c13ebc11-5268-4e08-8484-b8f55ac8e3c8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047565 May 31 15:11:43.352675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 871/1754] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:43.859555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:43.860204 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:43.866787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:43.867241 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:43.868017 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:43.868460 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:44.010628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:44.019399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8fb6d354-7504-4117-838a-e79b70c2f3ca tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1368 microversion: 2.1 time: 0.163752 May 31 15:11:44.020555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 884/1755] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:43 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:44.364768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:44.365702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:44.372282 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:44.372746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:44.373519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:44.373961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:44.405982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-81fb91bd-26e4-4990-848c-faed95cea003 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045213 May 31 15:11:44.406563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 872/1756] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:45.038091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:45.038735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:45.045597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.046049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.046835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.047266 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.186933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:11:45.194474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3648d805-3b20-428e-99f8-8f039689960f tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1559 microversion: 2.1 time: 0.160662 May 31 15:11:45.195089 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 885/1757] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:11:45 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:11:45.211244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:45.211785 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:45.218243 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.218721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.219496 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.219930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.304858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2d888f96-5653-428d-b09f-065cef4af071 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097505 May 31 15:11:45.305492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 873/1758] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 15:11:45 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:45.419109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:45.420063 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:45.426380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.426864 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.427672 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:45.428293 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:45.462628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b5fa66ed-aa1f-4d77-b2eb-d16bb7121b20 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048485 May 31 15:11:45.467145 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 886/1759] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:46.476123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:46.476803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:46.499847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:46.500913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:46.502428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:46.503274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:46.564667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b8221952-aafa-4d4f-bbed-d89d1add8a67 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093427 May 31 15:11:46.567820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 874/1760] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:46.643010 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-3825186b-0f45-4e05-8cc6-186df8ea4c39 req-baf13ffb-be6b-4ae2-ae36-30c0190bbb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1632c3-9777-4687-85df-676c6d678852", "tag": "64e2313a-18e9-4117-8b59-c959e9457198"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:11:46.651656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3825186b-0f45-4e05-8cc6-186df8ea4c39 req-baf13ffb-be6b-4ae2-ae36-30c0190bbb59 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:46.656839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-3825186b-0f45-4e05-8cc6-186df8ea4c39 req-baf13ffb-be6b-4ae2-ae36-30c0190bbb59 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:46.664750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-3825186b-0f45-4e05-8cc6-186df8ea4c39 req-baf13ffb-be6b-4ae2-ae36-30c0190bbb59 service nova] Creating event network-changed:64e2313a-18e9-4117-8b59-c959e9457198 for instance 4c1632c3-9777-4687-85df-676c6d678852 on hv-cinder-83979 May 31 15:11:46.670071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-3825186b-0f45-4e05-8cc6-186df8ea4c39 req-baf13ffb-be6b-4ae2-ae36-30c0190bbb59 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135674 May 31 15:11:46.671114 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 887/1761] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:47.586733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:47.588526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:47.599118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:47.599612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:47.600607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:47.600991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:47.635504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a9d76b1a-76f1-4424-8668-ef200b1fc3ad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058386 May 31 15:11:47.636107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 875/1762] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:48.648169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:48.649202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:48.656080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:48.656537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:48.657317 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:48.657757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:48.690121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4990c5ae-a2af-4996-b6d2-68618ea99963 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046386 May 31 15:11:48.690816 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 888/1763] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:49.703401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:49.704718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:49.715430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:49.715430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:49.715430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:49.716267 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:49.750979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5afe5e49-18de-4675-8eee-d56ae2367ce6 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052440 May 31 15:11:49.751694 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 876/1764] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:11:50.762701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:50.763564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:50.770077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:50.770527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:50.771318 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:50.771757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:50.800608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b0556d2a-7790-49ca-bd2e-b32c9fe479fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042560 May 31 15:11:50.801155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 889/1765] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:51.812268 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:51.813204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:51.821560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:51.822019 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:51.822848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:51.823300 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:51.863511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f84cf371-e687-4967-8b52-5e8cd2265fff tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055148 May 31 15:11:51.864083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 877/1766] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:52.875656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:52.876569 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:52.883342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:52.883786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:52.884542 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:52.884971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:52.914722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9152c552-474d-46cc-bd78-7256012aca0f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042980 May 31 15:11:52.915297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 890/1767] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:52 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:53.926675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:53.927606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:53.934624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:53.935107 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:53.935905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:53.936335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:53.966165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3c7b260a-d209-437c-bccb-0fdde778bb3f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043383 May 31 15:11:53.966651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 878/1768] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:54.977532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:54.978459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:54.985154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:54.985611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:54.986384 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:54.986855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:55.017502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d133a32d-ca02-4a2c-bd64-2040036f1ac9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043921 May 31 15:11:55.018075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 891/1769] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:56.030012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:56.031012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:56.038246 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:56.038714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:56.039491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:56.039929 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:56.069804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d0495658-1f56-42a2-8452-2b6125116400 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044382 May 31 15:11:56.070370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 879/1770] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:57.081796 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:57.082781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:57.089432 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:57.089886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:57.090739 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:57.091112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:57.093576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=100 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:11:57.122248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-27adba96-d814-455d-97da-3c40ae131993 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044612 May 31 15:11:57.122851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 892/1771] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:58.133743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:58.134721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:58.141825 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:58.142286 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:58.143092 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:58.143542 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:58.173841 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-971bd937-d23f-491a-8f94-bc55936eb266 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043983 May 31 15:11:58.174700 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 880/1772] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:11:59.185398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:11:59.186319 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:11:59.192896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:59.193353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:59.194116 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:11:59.194556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:11:59.224229 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-89460bd3-0732-4be3-873d-dc6919fe5749 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042690 May 31 15:11:59.224705 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 893/1773] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:11:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:00.236371 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:00.237368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:00.243978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:00.244417 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:00.245762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:00.246214 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:00.260968 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=100 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:00.277904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1deda775-ecd5-403a-89e4-257c69b40bd7 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045475 May 31 15:12:00.278594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 881/1774] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:01.290354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:01.291330 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:01.298914 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:01.299391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:01.300165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:01.300641 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:01.332425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c37e9a52-e5b5-4be4-a551-06626fdf536f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046331 May 31 15:12:01.333016 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 894/1775] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:02.347699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:02.349074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:02.356630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:02.359248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:02.359248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:02.359248 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:02.390639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-561861bc-1a46-42e0-9f0a-a7d3f9d9fd57 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049659 May 31 15:12:02.391395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 882/1776] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:03.401906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:03.402832 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:03.410370 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:03.410852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:03.411901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:03.412818 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:03.443947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-12a9a2be-27e0-4e3f-acae-c5bbee90e08b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046159 May 31 15:12:03.444546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 895/1777] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:04.455606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:04.456531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:04.463108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:04.463560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:04.464324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:04.464772 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:04.493622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e5595091-78ef-4142-ac9f-f0f78b4ccc5a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041941 May 31 15:12:04.494181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 883/1778] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:05.505599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:05.506503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:05.513047 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:05.513491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:05.514243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:05.514697 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:05.545202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6222a52b-0861-4015-a71a-306797694f91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043696 May 31 15:12:05.545764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 896/1779] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:06.538909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:12:06.539530 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:12:06.556752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:06.557750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:06.564162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:06.564611 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:06.565370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:06.565808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:06.594887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e6edffe6-9d32-4fac-b317-b1fae8ad5142 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041974 May 31 15:12:06.595432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 884/1780] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:07.607055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:07.607986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:07.614496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:07.614978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:07.615742 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:07.616185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:07.645735 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d36c3d0a-7e6c-4aa8-a97d-0a300c78a432 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043099 May 31 15:12:07.646281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 897/1781] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:08.658096 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:08.658981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:08.661577 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=38 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:08.667044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:08.667511 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:08.668287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:08.668737 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:08.700301 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-dae91b26-a90c-4a27-acf5-bbc524c99db5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046224 May 31 15:12:08.700879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 885/1782] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:09.712015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:09.712856 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:09.715618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=38 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:09.721323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:09.721837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:09.722520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:09.722976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:09.752608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bfb87a56-6670-4262-87bf-dbe411e2830a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044544 May 31 15:12:09.753161 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 898/1783] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:10.764996 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:10.765946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:10.772405 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:10.772856 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:10.773613 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:10.774047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:10.804318 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-790d70a3-9c27-45a5-b5f7-3ab4a11ea6ed tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043875 May 31 15:12:10.804863 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 886/1784] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:10 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:11.815909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:11.817004 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:11.826866 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:11.827312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:11.828690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:11.829125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:11.859606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9a45899e-66af-4a4b-aae6-538cd72c68b4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047554 May 31 15:12:11.860165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 899/1785] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:12.871699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:12.872622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:12.879078 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:12.879540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:12.880303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:12.880744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:12.914713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-42126072-f4fb-4b80-8796-9a0ccab40f40 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046921 May 31 15:12:12.915283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 887/1786] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:13.925758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:13.926585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:13.933715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:13.934162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:13.934954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:13.935394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:13.965487 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ee02c7bd-4490-4013-90d0-6216cb619111 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043789 May 31 15:12:13.966052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 900/1787] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:14.977407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:14.978360 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:14.984702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:14.985159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:14.985933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:14.986377 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:15.016963 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b6875bfd-1e22-4577-bd0d-24f7cd94af5e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043566 May 31 15:12:15.017561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 888/1788] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:16.028831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:16.029762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:16.036522 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:16.036996 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:16.037799 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:16.038236 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:16.068664 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1b6d36a8-5dbf-433e-a478-d82654fa3dad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043852 May 31 15:12:16.069228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 901/1789] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:17.080385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:17.081358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:17.087807 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:17.088790 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:17.089551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:17.089988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:17.120318 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9199c6f4-245b-44fa-bd83-302907755169 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043847 May 31 15:12:17.120883 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 889/1790] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:18.131264 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:18.132197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:18.138749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:18.139196 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:18.139950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:18.140380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:18.185587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-57c29dcb-b8c2-4ac7-ad9e-ea73218d7e94 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058129 May 31 15:12:18.186465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 902/1791] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:19.199648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:19.200595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:19.207181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:19.207627 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:19.208391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:19.208826 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:19.239887 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e17ec8c0-6ac0-4e3a-8bca-2a82c4f25aaa tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044451 May 31 15:12:19.240464 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 890/1792] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:20.251807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:20.252734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:20.259299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:20.259749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:20.260517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:20.260951 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:20.293099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dbc1a54d-4feb-4cb3-9d94-56869f476a5b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045233 May 31 15:12:20.293708 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 903/1793] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:21.304340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:21.305266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:21.312374 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:21.312829 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:21.313594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:21.314044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:21.343392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b6d70ef9-cde1-4c5a-bab9-2aad2eda98ca tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042996 May 31 15:12:21.343961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 891/1794] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:22.355843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:22.356757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:22.363334 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:22.363782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:22.364550 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:22.364988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:22.394605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3d8fbe87-2f5d-4476-bd8e-d4a8c1ebfb63 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043369 May 31 15:12:22.395120 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 904/1795] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:22.690743 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:12:22.691296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:12:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:12:23.406259 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:23.407144 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:23.413889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:23.414342 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:23.415132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:23.415575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:23.445054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-714c59d6-b84f-44bc-9ad6-d9fa431aeaa5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042852 May 31 15:12:23.445643 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 892/1796] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:24.457621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:24.458461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:24.465230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:24.465678 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:24.466452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:24.466917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:24.497865 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-71d68982-5008-46ed-8b1e-ce4143540055 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044405 May 31 15:12:24.498627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 905/1797] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:25.509708 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:25.510451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:25.517237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:25.517707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:25.518514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:25.519030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:25.549748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4313678b-1e0b-492a-9cc6-235397590c8a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044118 May 31 15:12:25.550306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 893/1798] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:25 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:26.562186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:26.563137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:26.569699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:26.570159 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:26.570963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:26.571408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:26.600137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f350059a-27e1-4fae-9daa-6de68144fd92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041970 May 31 15:12:26.600692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 906/1799] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:27.612560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:27.613587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:27.620404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:27.620855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:27.621644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:27.622071 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:27.655589 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1635a17a-6357-4436-9d02-62ac7c4a162e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046712 May 31 15:12:27.656480 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 894/1800] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:27 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:28.669707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:28.670756 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:28.677652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:28.678220 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:28.679100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:28.679611 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:28.682995 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:28.712874 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a75401af-305d-47d7-9cbf-74513d5ce807 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047665 May 31 15:12:28.713461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 907/1801] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:29.726329 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:29.727427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:29.734780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:29.735239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:29.736033 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:29.736471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:29.769209 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24ef6f15-79da-4e28-88ca-c4497574f9c1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046805 May 31 15:12:29.769729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 895/1802] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:30.781528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:30.782405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:30.789851 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:30.790303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:30.791118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:30.791557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:30.826219 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ebfcfa89-a2a1-43ea-ba09-ed9dcba1bbb4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048773 May 31 15:12:30.826850 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 908/1803] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:31.841997 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:31.843638 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:31.854357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:31.855182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:31.856546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:31.857331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:31.863880 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=88 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:31.893297 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-beb871c5-b1c0-4e54-ba7e-2a2caef3474d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059193 May 31 15:12:31.893862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 896/1804] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:31 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:32.905103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:32.906059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:32.917933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:32.918380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:32.919206 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:32.919639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:32.961835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2be68ce7-d3c0-4145-a3bc-1bd4a5702503 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060600 May 31 15:12:32.962426 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 909/1805] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:32 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:33.974333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:33.975436 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:33.983443 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:33.983901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:33.984698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:33.985146 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:34.019792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cd98304d-a57e-46ab-939b-9b12224c13b9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049997 May 31 15:12:34.020382 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 897/1806] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:33 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:35.033130 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:35.034273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:35.042125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:35.042749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:35.043968 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:35.044525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:35.080275 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6fd07b2e-740c-4f3f-96c6-b3a27e366b09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051431 May 31 15:12:35.080781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 910/1807] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:35 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:36.093764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:36.094886 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:36.102593 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:36.103081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:36.103888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:36.104361 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:36.139354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-94142a7c-4c0b-4741-b551-b108a24e0d28 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050285 May 31 15:12:36.140321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 898/1808] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:36 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:37.152721 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:37.153993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:37.161599 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:37.162062 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:37.162893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:37.163343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:37.199418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7b703f2e-3054-447b-b565-8bb6fc2b8a1d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051198 May 31 15:12:37.199967 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 911/1809] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:37 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:38.212138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:38.213644 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:38.221276 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:38.221744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:38.222552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:38.223040 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:38.257901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b88e5dd-f2c7-4a5f-b4b9-131bc7bc6f1a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049937 May 31 15:12:38.258430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 899/1810] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:38 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:39.269890 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:39.270869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:39.278701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:39.279155 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:39.279957 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:39.280399 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:39.314587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a8449571-4aa5-49f8-989b-7f792852f7f0 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048677 May 31 15:12:39.315239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 912/1811] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:39 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:40.326949 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:40.327955 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:40.330449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:40.336379 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:40.336838 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:40.338145 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:40.338599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:40.373587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-78b94549-e408-4f45-9ed7-3d59f65f5072 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050794 May 31 15:12:40.374129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 900/1812] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:40 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:41.385612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:41.386476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:41.389036 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:12:41.394618 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:41.395099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:41.395899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:41.396336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:41.432277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-693184c7-1fc0-45fa-889e-edd89e59d446 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050277 May 31 15:12:41.432882 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 913/1813] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:41 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:42.446104 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:42.447128 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:42.454493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:42.454981 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:42.455774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:42.456211 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:42.491244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-02c72979-fd20-4b0e-b7ea-085e1cb2429e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048922 May 31 15:12:42.491800 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 901/1814] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:42 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:43.506059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:43.507376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:43.515371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:43.515830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:43.516636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:43.517079 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:43.550268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e9ba1aa-8f6b-417e-9d76-22b7c01f8502 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048515 May 31 15:12:43.550909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 914/1815] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:43 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:44.563270 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:44.564197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:44.570595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:44.571086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:44.571879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:44.572320 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:44.606101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-485e2d51-1177-454f-bda5-eebe4191db70 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047105 May 31 15:12:44.606701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 902/1816] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:44 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:45.619012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:45.619985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:45.626545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:45.627041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:45.627829 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:45.628276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:45.663064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8b2c9c46-9c45-48b0-bd0a-1704cd8c7ce8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048706 May 31 15:12:45.663647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 915/1817] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:45 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:46.675767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:46.676721 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:46.684872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:46.685332 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:46.686123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:46.686576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:46.719744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-73c5e8cb-a92a-4485-bb5b-5fcd33a8d0d9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048015 May 31 15:12:46.720256 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 903/1818] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:46 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:47.734429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:47.735526 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:47.743162 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:47.744104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:47.744899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:47.745485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:47.780356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2b6f96c6-041b-4886-867d-fa82e4f40cc9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050280 May 31 15:12:47.780872 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 916/1819] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:47 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:48.793487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:48.794289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:48.801820 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:48.802356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:48.803264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:48.803818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:48.839125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5615d83d-d791-4310-9690-dfaae97b2819 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050141 May 31 15:12:48.839774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 904/1820] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:48 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:49.851057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:49.851997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:49.859736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:49.860189 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:49.860974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:49.861420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:49.896128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-be02dbc3-b850-4b42-a075-c3064bca4265 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048995 May 31 15:12:49.896651 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 917/1821] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:49 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:50.908402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:50.909442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:50.916791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:50.917255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:50.918059 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:50.918508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:50.953367 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ba021a19-bb23-4422-aeda-a373fed8ebdf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049099 May 31 15:12:50.954041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 905/1822] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:50 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:51.967247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:51.968303 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:51.975433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:51.975971 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:51.976820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:51.977306 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:52.013003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7ecae5ac-9314-47c8-a283-770145b075bf tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049773 May 31 15:12:52.013516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 918/1823] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:51 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:53.025691 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:53.026637 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:53.033701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:53.034159 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:53.034995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:53.035698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:53.069678 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5684694b-f935-4b5e-a143-415f398d4d1f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048527 May 31 15:12:53.070180 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 906/1824] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:53 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:54.081175 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:54.082124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:54.089181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:54.089627 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:54.090414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:54.090900 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:54.125774 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b7dcd77-63b2-49aa-8f1d-8c983b1f3a0a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048485 May 31 15:12:54.130810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 919/1825] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:54 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:55.139756 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:55.140679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:55.147733 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:55.149699 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:55.150598 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:55.151143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:55.187204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c542a8b5-7dd1-49e0-9d7f-40c4a207b9c5 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051651 May 31 15:12:55.187810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 907/1826] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:55 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:12:56.200053 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:56.201020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:56.208338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:56.208795 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:56.209590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:56.210034 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:56.246982 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a72eed22-7a99-43be-9d68-bbc89c599e92 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051380 May 31 15:12:56.247472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 920/1827] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:56 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:57.264081 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:57.265830 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:57.278718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:57.279541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:57.280991 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:57.281795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:57.344012 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5dd3d953-9d41-47f3-8a8c-51eb8e7d04c4 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087020 May 31 15:12:57.344950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 908/1828] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:57 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:58.358497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:58.359392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:58.366429 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:58.366935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:58.367734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:58.368722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:58.403869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-91667832-39f6-4893-ac46-b8d1c3f78250 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049637 May 31 15:12:58.404464 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 921/1829] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:58 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:12:59.417899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:12:59.418853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:12:59.426146 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:59.426619 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:59.427503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:12:59.428013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:12:59.461729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c0692349-0c86-4634-b772-c2556a90b55b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048578 May 31 15:12:59.462326 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 909/1830] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:12:59 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:00.476086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:00.476937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:00.483803 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:00.484258 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:00.485052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:00.485497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:00.488309 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=90 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:13:00.520896 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9f21e59e-c3a6-422b-9115-551554e39f09 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049079 May 31 15:13:00.521510 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 922/1831] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:00 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:01.533153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:01.534142 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:01.542594 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:01.543111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:01.544020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:01.544477 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:01.577500 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f00a347b-013a-4d5d-80dd-d9a88b0e3831 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048363 May 31 15:13:01.578011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 910/1832] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:01 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:01.860083 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:01.860663 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:01.866878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:01.867320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:01.868118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:01.868551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:01.894472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-cc49d17f-abb1-4da2-8649-03e298f982cc tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/ips" status: 200 len: 151 microversion: 2.1 time: 0.236464 May 31 15:13:01.895074 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 923/1833] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 15:13:01 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/ips => generated 151 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:02.589888 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:02.590904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:02.598227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:02.598714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:02.599509 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:02.599958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:02.603221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=90 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:13:02.639476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9c7390ed-42fb-44e4-912e-8723e1c89310 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053595 May 31 15:13:02.639977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 911/1834] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:02 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:03.651807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:03.652645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:03.660597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:03.661052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:03.661853 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:03.662455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:03.695928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9eeafd5e-d5d3-447b-b93e-8d5f9fb63b91 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048223 May 31 15:13:03.697164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 924/1835] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:03 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:04.710994 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:04.712494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:04.719769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:04.720231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:04.721035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:04.721491 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:04.756723 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9340b929-9beb-4f41-8ab3-ee43ed5a5927 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049766 May 31 15:13:04.757314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 912/1836] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:04 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:05.768371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:05.769449 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:05.777244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:05.777699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:05.778503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:05.778990 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:05.813531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e5f35d51-1994-4242-b5bf-9cdc4ddd6277 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049340 May 31 15:13:05.814139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 925/1837] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:05 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:06.826579 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:06.827479 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:06.834551 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:06.835055 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:06.835871 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:06.836324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:06.871539 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e318177e-1dbd-4fa9-a22c-8e90d134bada tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049254 May 31 15:13:06.872321 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 913/1838] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:06 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:07.883734 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:07.884684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:07.891805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:07.892260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:07.893058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:07.893502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:07.928320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ee327fa2-8b86-4f61-b7d2-5f4e94a0f421 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048626 May 31 15:13:07.928964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 926/1839] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:07 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:08.941255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:08.942168 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:08.950137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:08.950599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:08.951449 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:08.951898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:08.987306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-139a74aa-2d26-4a6d-bb0f-440f730c4b86 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050273 May 31 15:13:08.987917 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 914/1840] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:08 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:10.000635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:10.001592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:10.009102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:10.009551 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:10.010354 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:10.010839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:10.049401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d060be55-347a-4539-af88-74004ef7503c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052807 May 31 15:13:10.050013 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 927/1841] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:09 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:11.064122 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:11.065083 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:11.067631 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:13:11.073547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:11.074008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:11.074848 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:11.075293 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:11.112139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-187dc439-96e7-4686-b0e7-181748baa75f tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052107 May 31 15:13:11.112791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 915/1842] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:11 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:12.126405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:12.127855 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:12.131333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:13:12.142209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:12.144494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:12.144494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:12.144494 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:12.179674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b79d4cb9-0916-4037-9f69-495a7c2b03ee tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057828 May 31 15:13:12.180929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 928/1843] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:12 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:13.193401 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:13.194442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:13.202006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:13.202512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:13.203455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:13.204020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:13.241166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bea7e4fe-df1d-4d17-b79a-ec60d6b272b3 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052164 May 31 15:13:13.241762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 916/1844] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:13 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:14.254846 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:14.255800 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:14.263014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:14.263514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:14.264297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:14.264724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:14.299417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0ea14159-2fc5-47ed-b247-d6f93806d60e tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049692 May 31 15:13:14.300263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 929/1845] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:14 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:15.314362 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:15.315541 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:15.323106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:15.323617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:15.324475 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:15.324973 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:15.358706 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-02a0962d-835b-450f-ace6-16c6943d1196 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050081 May 31 15:13:15.359294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 917/1846] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:15 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:16.370825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:16.371757 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:16.378899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:16.379363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:16.380147 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:16.380637 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:16.416442 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f04736a0-cb35-4d22-8208-cfa0613faaa8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049640 May 31 15:13:16.417039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 930/1847] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:16 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:17.428794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:17.429969 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:17.437775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:17.438328 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:17.439247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:17.439780 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:17.472677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5645bdd5-87e1-4fe9-a8d0-ebef057e2f7a tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048014 May 31 15:13:17.473274 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 918/1848] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:17 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:18.484913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:18.485805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:18.492950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:18.493401 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:18.494212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:18.494689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:18.528989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d76f92ac-3d52-4eef-9bbc-91ea7d812feb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048071 May 31 15:13:18.529593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 931/1849] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:18 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:19.543748 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:19.544939 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:19.555347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:19.556028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:19.557020 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:19.557617 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:19.591842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d8acd890-1bb4-4fcc-ba19-1d6ffc4eef38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053161 May 31 15:13:19.592438 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 919/1850] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:19 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:20.603786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:20.604715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:20.611561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:20.612006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:20.612790 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:20.613221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:20.648290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-613a4ee6-e08c-458f-8c7a-645b5287ebbd tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048618 May 31 15:13:20.649006 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 932/1851] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:20 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:21.661053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:21.662111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:21.670858 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:21.671310 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:21.672101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:21.672543 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:21.705587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4ffa2fce-f689-42dd-96a9-8e220bf21440 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048776 May 31 15:13:21.706093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 920/1852] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:21 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:22.718877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:22.719835 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:22.726930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:22.727391 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:22.728185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:22.728639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:22.764897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f130b47-1238-4655-9777-d6b675c28e38 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050461 May 31 15:13:22.765493 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 933/1853] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:22 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:23.777976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:23.778877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:23.786504 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:23.787004 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:23.787821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:23.788279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:23.824538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d2a46747-7cf8-43dc-b394-fe1575105e74 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051270 May 31 15:13:23.825414 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 921/1854] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:23 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:13:24.838423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:13:24.839422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:24.847234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:24.847768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:24.848570 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:24.849015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:24.884277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8b6b5a86-d4bf-41e9-9253-cd4e62beee45 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050626 May 31 15:13:24.885064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 934/1855] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:13:24 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:13:25.897187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:13:25.898139 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:13:25.905304 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:25.905766 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:25.906569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:13:25.907049 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:13:25.979552 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-066e2998-a491-4b17-8632-8134981197d8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/action" status: 200 len: 41331 microversion: 2.1 time: 0.086172 May 31 15:13:25.980251 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 922/1856] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 15:13:25 2022] POST /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e/action => generated 41331 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 15:13:38.126170 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:13:38.127331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:13:38.321382 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:13:38.322338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:13:45.498363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:13:45.499089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:14:27.265407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:14:27.266500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:15:26.548068 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:15:26.549243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:15:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:16:58.141626 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:16:58.142331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:16:58.330958 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:16:58.331836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:17:05.508148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:17:05.508753 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:17:47.276984 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:17:47.278164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:18:12.454400 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a1e6162-94ff-4f37-9f95-9300bf909a60"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:12.456215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:12.461719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 31 15:18:12.462600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=13 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:12.463478 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=75 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:12.475081 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:12.475877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:12.477314 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:12.478072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:13.473748 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57642. May 31 15:18:13.643635 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6dd3d3c3-7fbd-4c8f-83ca-76e2c03516bf tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.197246 May 31 15:18:13.644350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 935/1857] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 15:18:12 2022] POST /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments => generated 194 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:18:21.214528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f61dd80-5dd4-4183-8dd3-bdd02f7be619] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 31 15:18:21.215424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=15 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:21.215874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=69 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:21.221787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a1e6162-94ff-4f37-9f95-9300bf909a60"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:21.223034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:21.231877 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.232348 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.233152 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.233599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.378920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: POST /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments HTTP/1.1 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 74 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:18:21.381478 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {"volumeAttachment": {"volumeId": "2a1e6162-94ff-4f37-9f95-9300bf909a60"}} May 31 15:18:21.384732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'server_id': '4c1632c3-9777-4687-85df-676c6d678852', 'body': {'volumeAttachment': {'volumeId': '2a1e6162-94ff-4f37-9f95-9300bf909a60'}}} May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:18:21.386986 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:21.390559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 400 to user: Invalid volume: volume 2a1e6162-94ff-4f37-9f95-9300bf909a60 is already attached to instances: 4c1632c3-9777-4687-85df-676c6d678852 {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7ad04511-725e-49fc-be3f-39666815c8c2 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170696 May 31 15:18:21.393738 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 923/1858] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 15:18:21 2022] POST /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 31 15:18:21.460837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:21.461498 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:21.468782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.469508 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.470701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.471216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.569149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lazy-loading 'services' on Instance uuid 4c1632c3-9777-4687-85df-676c6d678852 {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:18:21.651058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-9ea053b1-42b2-49af-9051-b465d6b0f055 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments/2a1e6162-94ff-4f37-9f95-9300bf909a60" status: 202 len: 0 microversion: 2.1 time: 0.194968 May 31 15:18:21.651752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 936/1859] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 15:18:21 2022] DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments/2a1e6162-94ff-4f37-9f95-9300bf909a60 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:18:21.665662 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:21.667393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:21.678305 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.679258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.680288 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:21.681042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:21.722215 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d5398220-f978-4473-95e3-41da8e130301 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064674 May 31 15:18:21.723084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 924/1860] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:18:21 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:18:22.738776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:22.739873 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:22.746436 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:22.746972 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:22.748344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:22.748788 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:22.780845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8e3cb226-949f-404d-8b0c-9e4c5c480c90 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048803 May 31 15:18:22.781438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 937/1861] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:18:22 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 15:18:22.844945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:22.845680 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:22.855388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:22.855982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:22.857433 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:22.858204 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:22.867786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f61dd80-5dd4-4183-8dd3-bdd02f7be619] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57726. May 31 15:18:22.893413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:18:22.965118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [1661de21-8738-42f0-aa78-000d00129cb7] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 31 15:18:23.975137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [1661de21-8738-42f0-aa78-000d00129cb7] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57732. May 31 15:18:24.008707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-05bdf907-9647-458d-8610-fb59e4ec198a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 204 len: 0 microversion: 2.1 time: 1.167666 May 31 15:18:24.009602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 925/1862] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:18:22 2022] DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 0 bytes in 1169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 15:18:24.019110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:24.019886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:24.027395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:24.027915 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:24.029488 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:24.029937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:24.185897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:24.194634 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-253b5ad9-9028-4df2-af00-68325d933d6a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1684 microversion: 2.1 time: 0.180072 May 31 15:18:24.195549 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 938/1863] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:24 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:25.214311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:25.215056 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:25.222149 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:25.222616 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:25.223484 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:25.224029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:25.413711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:25.423716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-61c76bb4-c445-4a3b-be1d-a3d92bb938a8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1684 microversion: 2.1 time: 0.213790 May 31 15:18:25.424403 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 926/1864] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:25 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1684 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:26.148924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-b1325cc3-b64c-4f2f-b493-255b8a618061 req-b5c022b9-5534-4aa1-867d-3ee6ff95e456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1632c3-9777-4687-85df-676c6d678852", "name": "network-vif-deleted", "tag": "64e2313a-18e9-4117-8b59-c959e9457198"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:26.188176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-b1325cc3-b64c-4f2f-b493-255b8a618061 req-b5c022b9-5534-4aa1-867d-3ee6ff95e456 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:26.189535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-b1325cc3-b64c-4f2f-b493-255b8a618061 req-b5c022b9-5534-4aa1-867d-3ee6ff95e456 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:26.220078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-b1325cc3-b64c-4f2f-b493-255b8a618061 req-b5c022b9-5534-4aa1-867d-3ee6ff95e456 service nova] Creating event network-vif-deleted:64e2313a-18e9-4117-8b59-c959e9457198 for instance 4c1632c3-9777-4687-85df-676c6d678852 on hv-cinder-83979 May 31 15:18:26.230209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-b1325cc3-b64c-4f2f-b493-255b8a618061 req-b5c022b9-5534-4aa1-867d-3ee6ff95e456 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263771 May 31 15:18:26.231729 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 939/1865] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:18:26.445028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:26.446336 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:26.453794 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:26.454242 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:26.455093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:26.455718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:26.492576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:26.493031 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:26.493701 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lazy-loading 'fault' on Instance uuid 4c1632c3-9777-4687-85df-676c6d678852 {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:18:26.543456 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:26.552587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4187cd60-b3a4-4b00-b3f7-530cc9e5b9e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 200 len: 1332 microversion: 2.1 time: 0.111893 May 31 15:18:26.553788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 927/1866] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:26 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:27.574058 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:27.574716 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:27.581572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:27.582060 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:27.583030 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:27.583496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:27.599137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 HTTP/1.1 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:18:27.600834 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:18:27.603420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '4c1632c3-9777-4687-85df-676c6d678852'} May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:18:27.604838 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:18:27.607935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:18:27.610787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:18:27.610787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-100c9e2f-53da-4c08-8222-8ffaa184e7ae tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 404 len: 111 microversion: 2.1 time: 0.033507 May 31 15:18:27.610787 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 940/1867] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:27 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:18:27.613795 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a7b7ec32-d9c4-47ee-8ae1-7dd2091c41b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '.version_select at 0x7f8dc892f0d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:27.636962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a7b7ec32-d9c4-47ee-8ae1-7dd2091c41b6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067420576" status: 202 len: 0 microversion: 2.1 time: 0.028370 May 31 15:18:27.637550 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 928/1868] 10.222.0.67 () {58 vars in 1220 bytes} [Tue May 31 15:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067420576 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 15:18:28.476546 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-afff1987-e26c-44a0-aa49-aee87b2071ed tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: .version_select at 0x7f8dbf4e2f70>, body: {"keypair": {"name": "tempest-keypair-1693065005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiV4ICyPMX4f1TVm/7fiLoOMghdPdLCpXTB5ONMKGIgNX/8ARuhV8JQzHZtJFgNu6lItFi1zkWWTRhCvcZ9YYvyLzz4Ux+mIjpPbE7afN5JChMpOCEj4UmohZngzDleag=="}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:28.492177 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-afff1987-e26c-44a0-aa49-aee87b2071ed tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:18:28.497394 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-afff1987-e26c-44a0-aa49-aee87b2071ed tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'key_pairs'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:18:28.532506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-afff1987-e26c-44a0-aa49-aee87b2071ed tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059650 May 31 15:18:28.533336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 941/1869] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 15:18:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:18:30.019734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1773281101", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5750f2c5-2b61-4d8b-8c4e-2d47f35308a2"}], "security_groups": [{"name": "tempest-securitygroup--1563940535"}], "key_name": "tempest-keypair-1693065005", "user_data": "}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:30.146533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] validate_networks() for [('5750f2c5-2b61-4d8b-8c4e-2d47f35308a2', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:18:30.640905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:18:30.641507 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:18:30.642103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:18:30.642622 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:18:30.643218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:18:30.654827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:30.655287 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:30.656118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:30.656564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:30.677021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:18:30.681933 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Getting quotas for user 7a8df9e916ba4542af81e2a29229c1db and project 5bd34785f6d847ae8cb5be4e07d29c38. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:18:30.695269 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:18:30.697671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:18:30.754928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-1019c433-0efd-4d14-bee7-3c14a46a55f7 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.742788 May 31 15:18:30.755812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 929/1870] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:18:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:18:30.771520 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0f73b8fb-28b1-4579-8318-cff267607a98 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:30.772805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0f73b8fb-28b1-4579-8318-cff267607a98 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:30.844240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0f73b8fb-28b1-4579-8318-cff267607a98 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:30.856767 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0f73b8fb-28b1-4579-8318-cff267607a98 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1242 microversion: 2.1 time: 0.093072 May 31 15:18:30.857828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 942/1871] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:30 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:31.875951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-48d0e183-a4e2-4fd0-98c0-983d4b819a24 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:31.876874 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-48d0e183-a4e2-4fd0-98c0-983d4b819a24 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:31.954133 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-48d0e183-a4e2-4fd0-98c0-983d4b819a24 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:31.961299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-48d0e183-a4e2-4fd0-98c0-983d4b819a24 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1242 microversion: 2.1 time: 0.090413 May 31 15:18:31.961894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 930/1872] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:31 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:32.979227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6183eda1-1e47-4a80-80bf-77f4e61cd566 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:32.980102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6183eda1-1e47-4a80-80bf-77f4e61cd566 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:33.050625 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6183eda1-1e47-4a80-80bf-77f4e61cd566 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:33.062414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6183eda1-1e47-4a80-80bf-77f4e61cd566 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1242 microversion: 2.1 time: 0.087122 May 31 15:18:33.063395 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 943/1873] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:32 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:34.088039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-480e522e-d4a8-41a5-8661-527dac6a7b2d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:34.088663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-480e522e-d4a8-41a5-8661-527dac6a7b2d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:34.168234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-480e522e-d4a8-41a5-8661-527dac6a7b2d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:34.176768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-480e522e-d4a8-41a5-8661-527dac6a7b2d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1242 microversion: 2.1 time: 0.092516 May 31 15:18:34.177471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 931/1874] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:34 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:35.202467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:35.203285 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:35.211647 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:35.212289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:35.213344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:35.213880 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:35.292895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:35.301693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f914e976-b742-4874-9d37-22b7c3053d6e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1246 microversion: 2.1 time: 0.104151 May 31 15:18:35.302701 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 944/1875] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:35 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:36.326818 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:36.327787 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:36.338476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:36.339237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:36.340690 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:36.341468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:36.449932 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:36.460021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e866a666-2f0f-424c-a024-1dba30b607b3 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1300 microversion: 2.1 time: 0.140443 May 31 15:18:36.461021 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 932/1876] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:36 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:37.488681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:37.490778 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:37.503212 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:37.504001 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:37.505271 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:37.506098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:37.683225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:37.693350 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-199911cd-3be0-49d4-ac49-770f066473e6 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.212682 May 31 15:18:37.694140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 945/1877] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:37 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:37.797650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-68ce1a24-bfa5-4eff-804b-7ddb8c013eb8 req-bc209d38-66e6-48ad-9e89-58d77d21e0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a", "tag": "83fb7c8e-f586-464a-a5ce-0ae7e6c5e170"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:37.808885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-68ce1a24-bfa5-4eff-804b-7ddb8c013eb8 req-bc209d38-66e6-48ad-9e89-58d77d21e0f6 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:37.809915 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-68ce1a24-bfa5-4eff-804b-7ddb8c013eb8 req-bc209d38-66e6-48ad-9e89-58d77d21e0f6 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:37.823376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-68ce1a24-bfa5-4eff-804b-7ddb8c013eb8 req-bc209d38-66e6-48ad-9e89-58d77d21e0f6 service nova] Creating event network-changed:83fb7c8e-f586-464a-a5ce-0ae7e6c5e170 for instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a on hv-cinder-83979 May 31 15:18:37.831176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-68ce1a24-bfa5-4eff-804b-7ddb8c013eb8 req-bc209d38-66e6-48ad-9e89-58d77d21e0f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039296 May 31 15:18:37.832454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 933/1878] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:18:38.713138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:38.713786 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:38.721250 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:38.721690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:38.722480 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:38.722941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:38.888472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:38.896408 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-0b046698-ce18-4c3d-918f-460b0acc1f94 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.187029 May 31 15:18:38.896988 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 946/1879] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:38 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:39.916140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:39.916961 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:39.923837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:39.924373 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:39.925306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:39.925779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:40.075182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:40.083088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-16f1ca49-6823-4cc5-8718-279529d74d6d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.171955 May 31 15:18:40.083679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 934/1880] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:39 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:41.101152 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:41.101899 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:41.109879 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:41.110327 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:41.111163 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:41.111609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:41.268523 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:41.277472 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-47726b5e-cbb2-4bb9-955e-60cc0e02575e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.180215 May 31 15:18:41.279208 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 947/1881] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:41 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:42.296657 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:42.297358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:42.299306 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:42.305908 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:42.306369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:42.307201 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:42.307653 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:42.469669 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:42.483720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f895880a-f63e-482c-97d0-08d33465c797 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.191015 May 31 15:18:42.484788 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 935/1882] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:42 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:43.513078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:43.514389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:43.518341 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=8 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:43.519604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:43.532794 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:43.533604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:43.535527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:43.536547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:43.547769 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:43.746517 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:43.754389 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d4411edb-4ea9-4e6b-a00f-01cb8fa4afc8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.249146 May 31 15:18:43.755014 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 948/1883] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:43 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:44.030525 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-4c9fb9a2-4ab0-45af-b486-932cf6f3aa2b req-0613a336-4ba1-485e-bbe3-8282cd5be659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a", "name": "network-vif-plugged", "status": "completed", "tag": "83fb7c8e-f586-464a-a5ce-0ae7e6c5e170"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:44.045720 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4c9fb9a2-4ab0-45af-b486-932cf6f3aa2b req-0613a336-4ba1-485e-bbe3-8282cd5be659 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:44.046725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4c9fb9a2-4ab0-45af-b486-932cf6f3aa2b req-0613a336-4ba1-485e-bbe3-8282cd5be659 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:44.070474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-4c9fb9a2-4ab0-45af-b486-932cf6f3aa2b req-0613a336-4ba1-485e-bbe3-8282cd5be659 service nova] Creating event network-vif-plugged:83fb7c8e-f586-464a-a5ce-0ae7e6c5e170 for instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a on hv-cinder-83979 May 31 15:18:44.077158 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-4c9fb9a2-4ab0-45af-b486-932cf6f3aa2b req-0613a336-4ba1-485e-bbe3-8282cd5be659 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117679 May 31 15:18:44.078506 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 936/1884] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:18:44.772521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:44.773279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:44.780901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:44.781349 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:44.782125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:44.782561 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:44.964099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:44.972215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e261166-f91f-40e8-97ac-63e2f1e6c2c8 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.203506 May 31 15:18:44.972830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 949/1885] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:44 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:18:45.991206 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:45.992034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:45.994115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=10 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:18:46.006707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:46.008029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:46.008891 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:46.009346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:46.198606 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:46.214176 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ddf7ee42-2a0f-4865-9a45-9b692626b316 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1368 microversion: 2.1 time: 0.227849 May 31 15:18:46.214960 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 937/1886] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:45 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:46.558694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:18:46.559959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:18:47.233149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:47.233947 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:47.242544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:47.243237 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:47.244179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:47.244733 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:47.411027 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:18:47.419186 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c7d86528-08e1-466f-9f7c-afc107e6b88a tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1559 microversion: 2.1 time: 0.190176 May 31 15:18:47.419798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 950/1887] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:18:47 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:18:47.436797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:18:47.437439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:18:47.444912 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:47.445352 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:47.446157 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:47.446592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:47.539322 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-80ad5eb4-3530-42f2-a19d-a96a48a66754 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106617 May 31 15:18:47.540238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 938/1888] 10.222.0.67 () {58 vars in 1274 bytes} [Tue May 31 15:18:47 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:18:49.091652 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-d490dd07-d99b-4ee0-953c-a85af5d16c4d req-9b5dd292-3b35-42e5-80bb-073fca710a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a", "tag": "83fb7c8e-f586-464a-a5ce-0ae7e6c5e170"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:18:49.105039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d490dd07-d99b-4ee0-953c-a85af5d16c4d req-9b5dd292-3b35-42e5-80bb-073fca710a65 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:18:49.106234 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-d490dd07-d99b-4ee0-953c-a85af5d16c4d req-9b5dd292-3b35-42e5-80bb-073fca710a65 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:18:49.120194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-d490dd07-d99b-4ee0-953c-a85af5d16c4d req-9b5dd292-3b35-42e5-80bb-073fca710a65 service nova] Creating event network-changed:83fb7c8e-f586-464a-a5ce-0ae7e6c5e170 for instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a on hv-cinder-83979 May 31 15:18:49.126544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-d490dd07-d99b-4ee0-953c-a85af5d16c4d req-9b5dd292-3b35-42e5-80bb-073fca710a65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106784 May 31 15:18:49.127528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 951/1889] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:25.181088 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:25.181842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:25.186465 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:25.186993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:25.195312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:25.195769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:25.196560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:25.197006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:25.226944 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:19:25.306911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-37c85d62-70ef-438d-84f1-ab0551bcb55f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "DELETE /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 204 len: 0 microversion: 2.1 time: 0.126979 May 31 15:19:25.307568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 939/1890] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:19:25 2022] DELETE /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:19:25.316055 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=7 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:25.316931 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=19 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:25.321497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:25.322230 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:25.329784 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:25.330232 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:25.331045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:25.331479 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:25.469860 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:19:25.483533 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e58b94ed-2f34-437c-8a2f-77107d50fb52 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1554 microversion: 2.1 time: 0.168926 May 31 15:19:25.484731 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 952/1891] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:25 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:19:26.504048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:26.504867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:26.515604 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.516258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.517172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.518009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.612778 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '180eebbd503e441b9332720e70f7f339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24fdc4bc9ca442e948484e73713779c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:19:26.622068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a9b7ff7e-f32c-4266-9c7c-6fdd7673d61c tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 200 len: 1512 microversion: 2.1 time: 0.123045 May 31 15:19:26.622682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 940/1892] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:26 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 1512 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:19:26.642560 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:26.643165 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:26.651225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.652645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.653908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.654461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.672232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-a0d6254b-af0c-4b54-ab41-5874ba3f8e53 req-34c9c962-2fd9-4be9-8e3d-084768ca5ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621277b0-46a9-4b52-a8d8-c9a618c7b553", "name": "network-vif-deleted", "tag": "fb91d4b0-cf6e-4ab1-a335-d00d30643dec"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:19:26.685474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-a0d6254b-af0c-4b54-ab41-5874ba3f8e53 req-34c9c962-2fd9-4be9-8e3d-084768ca5ecd service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.686100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-a0d6254b-af0c-4b54-ab41-5874ba3f8e53 req-34c9c962-2fd9-4be9-8e3d-084768ca5ecd service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.691692 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:19:26.698951 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-a0d6254b-af0c-4b54-ab41-5874ba3f8e53 req-34c9c962-2fd9-4be9-8e3d-084768ca5ecd service nova] Creating event network-vif-deleted:fb91d4b0-cf6e-4ab1-a335-d00d30643dec for instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 on hv-cinder-83979 May 31 15:19:26.705309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-a0d6254b-af0c-4b54-ab41-5874ba3f8e53 req-34c9c962-2fd9-4be9-8e3d-084768ca5ecd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039819 May 31 15:19:26.706624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 941/1893] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:26.830639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-baf99723-3ed3-47ec-bae4-9ffcec5c26fb tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 204 len: 0 microversion: 2.1 time: 0.191669 May 31 15:19:26.831821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 953/1894] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:19:26 2022] DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:19:26.841945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:26.842673 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:26.849898 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.850346 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:26.851153 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:26.851595 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:27.011959 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:19:27.026789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-64522ad5-e1a6-4e2d-8417-9e30bac1597c tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1767 microversion: 2.1 time: 0.190106 May 31 15:19:27.027971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 942/1895] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:26 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1767 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:19:27.640459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:27.641176 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] [instance: 621277b0-46a9-4b52-a8d8-c9a618c7b553] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:27.647810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:27.648532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:27.649039 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:27.649474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:27.665356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] HTTP exception thrown: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Request method failure captured: May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 HTTP/1.1 May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili68tYYatLCq82aISuzySe0OixXoYcfdtcfv_nWCt466DWcDyvWXWttvDBkpi_p_rvT2YXbVhGfNotbIs9Z52xcg_iSDhQ1Qi7AfnoR4aWYMpEAH2WPGlnK0lyhZ7k4xefjOHNM8mhSqC2tcMK6kOrVPC6uefd_gsUUkNxgrTG2E7TQ May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: f24fdc4bc9ca442e948484e73713779c May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-TestMinimumBasicScenario-1516822200 May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:19:27.667681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f24fdc4bc9ca442e948484e73713779c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f24fdc4bc9ca442e948484e73713779c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f24fdc4bc9ca442e948484e73713779c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f24fdc4bc9ca442e948484e73713779c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-TestMinimumBasicScenario-1516822200 May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: f24fdc4bc9ca442e948484e73713779c May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1516822200 May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-TestMinimumBasicScenario-1516822200-project May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 180eebbd503e441b9332720e70f7f339 May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-TestMinimumBasicScenario-1516822200-project May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. May 31 15:19:27.669597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '621277b0-46a9-4b52-a8d8-c9a618c7b553'} May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:27.670710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. May 31 15:19:27.672529 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:27.674537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Returning 404 to user: Instance 621277b0-46a9-4b52-a8d8-c9a618c7b553 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:27.674537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f5c2bb2-b730-4dab-b2aa-61fc22f6cc1f tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553" status: 404 len: 111 microversion: 2.1 time: 0.033082 May 31 15:19:27.674537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 954/1896] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:27 2022] GET /compute/v2.1/servers/621277b0-46a9-4b52-a8d8-c9a618c7b553 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:27.677993 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-07d79eda-b841-4f3d-b0a6-7d6c27030524 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] Calling method '.version_select at 0x7f8dc89459d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:27.696315 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-07d79eda-b841-4f3d-b0a6-7d6c27030524 tempest-TestMinimumBasicScenario-1516822200 tempest-TestMinimumBasicScenario-1516822200-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-318445248" status: 202 len: 0 microversion: 2.1 time: 0.022119 May 31 15:19:27.696905 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 943/1897] 10.222.0.67 () {58 vars in 1268 bytes} [Tue May 31 15:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-318445248 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:19:28.050094 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:28.051288 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:28.062098 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:28.063257 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:28.064581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:28.065296 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:28.279497 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:19:28.288985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5b1f77bb-efc1-4215-9a57-85466f9b3aad tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1767 microversion: 2.1 time: 0.245221 May 31 15:19:28.289571 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 955/1898] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:28 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1767 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:19:29.207612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-cc002135-5769-4260-8969-29675b0615b4 req-52b3ccfe-526e-4d09-9b5f-359f96d90841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7381ef0b-479e-491d-a7c3-9f32109efb1e", "name": "network-vif-deleted", "tag": "220ffe71-7480-4e48-bb52-b8f0d9293ad6"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:19:29.227413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-cc002135-5769-4260-8969-29675b0615b4 req-52b3ccfe-526e-4d09-9b5f-359f96d90841 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:29.228920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-cc002135-5769-4260-8969-29675b0615b4 req-52b3ccfe-526e-4d09-9b5f-359f96d90841 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:29.249958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-cc002135-5769-4260-8969-29675b0615b4 req-52b3ccfe-526e-4d09-9b5f-359f96d90841 service nova] Creating event network-vif-deleted:220ffe71-7480-4e48-bb52-b8f0d9293ad6 for instance 7381ef0b-479e-491d-a7c3-9f32109efb1e on hv-cinder-83979 May 31 15:19:29.257919 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-cc002135-5769-4260-8969-29675b0615b4 req-52b3ccfe-526e-4d09-9b5f-359f96d90841 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058454 May 31 15:19:29.259732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 944/1899] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:29.315764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:29.317556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:29.342110 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:29.343045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:29.351111 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:29.351585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:29.483491 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36fb9afb5d54d3493e8752bae88dd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e870af07745948ffa62b2e59eb8054f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:19:29.498344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-99f80977-a239-4838-b1fa-5357fd647cf1 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 200 len: 1416 microversion: 2.1 time: 0.186324 May 31 15:19:29.512837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 956/1900] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:29 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 1416 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:19:30.529713 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:30.530995 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:30.549747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:30.551533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:30.551533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:30.551965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:30.573573 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e HTTP/1.1 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:19:30.576296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:30.577964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '7381ef0b-479e-491d-a7c3-9f32109efb1e'} May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:30.580791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:30.582575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:30.583957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:30.583957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ccc69cd9-ab7b-48c3-b98d-eba5f244bdf9 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 404 len: 111 microversion: 2.1 time: 0.061189 May 31 15:19:30.583957 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 945/1901] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:30 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:19:30.586963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-50b3b086-4be3-41ec-92ac-ee96df49b5fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '.version_select at 0x7f8dbf4d8670>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:30.608918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-50b3b086-4be3-41ec-92ac-ee96df49b5fc tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420979165" status: 202 len: 0 microversion: 2.1 time: 0.025456 May 31 15:19:30.609976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 957/1902] 10.222.0.67 () {58 vars in 1220 bytes} [Tue May 31 15:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420979165 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:19:34.456404 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:34.456913 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:34.464181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:34.464633 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:34.465423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:34.466061 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:34.481054 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e HTTP/1.1 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:19:34.482487 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.483584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '7381ef0b-479e-491d-a7c3-9f32109efb1e'} May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:34.484314 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.485440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:34.488043 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:34.489086 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-09006869-86e1-4e42-ad03-cdd8933769a8 tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 404 len: 111 microversion: 2.1 time: 0.036715 May 31 15:19:34.489739 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 946/1903] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:19:34 2022] DELETE /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:34.498976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:34.499918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: 7381ef0b-479e-491d-a7c3-9f32109efb1e] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:34.507021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:34.507473 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:34.508256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:34.508699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:34.524125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e HTTP/1.1 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:19:34.525689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.526762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '7381ef0b-479e-491d-a7c3-9f32109efb1e'} May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:34.527369 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. May 31 15:19:34.528948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:34.530045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance 7381ef0b-479e-491d-a7c3-9f32109efb1e could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:34.530045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-063420b2-6089-4798-905d-078cc92e68be tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e" status: 404 len: 111 microversion: 2.1 time: 0.033029 May 31 15:19:34.530045 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 958/1904] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:34 2022] GET /compute/v2.1/servers/7381ef0b-479e-491d-a7c3-9f32109efb1e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:35.709041 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:35.709614 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:35.718578 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:35.721453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:35.722392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:35.723003 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:35.741403 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 HTTP/1.1 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:19:35.743037 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.744253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'c80e99d1-9423-47b2-b602-c03b9019dc96'} May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:35.745108 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.746231 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:35.747265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:35.747265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-e05b4b99-0347-45ee-b6ff-1d32d3d5c76b tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 404 len: 111 microversion: 2.1 time: 0.040072 May 31 15:19:35.747265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 947/1905] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:19:35 2022] DELETE /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:35.753499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:35.758225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] [instance: c80e99d1-9423-47b2-b602-c03b9019dc96] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:19:35.762390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:35.762877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:35.763679 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:19:35.764180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:19:35.780115 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] HTTP exception thrown: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Request method failure captured: May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 HTTP/1.1 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABilih05HTqL7QTc38PN6pGYE4dzGgDfWDpAdJVjvZKc0Xw8PaCdITYmtcJGP_VJWa8b8vbIRqdkhhrAWcHEzCe6fQlW2C2SsfIKkA9IYxFidv-BDZV2IY4AjckGPjMDeF-t0cRfMAtJ6MxnJxWur6G0NfFDAKNOSpUOBOCn6qaeMRCa0A May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:19:35.781617 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e870af07745948ffa62b2e59eb8054f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: e870af07745948ffa62b2e59eb8054f4 May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1344976159 May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: a36fb9afb5d54d3493e8752bae88dd13 May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeTestJSON-1344976159-project May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.782631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'c80e99d1-9423-47b2-b602-c03b9019dc96'} May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:35.783377 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. May 31 15:19:35.784453 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:35.785455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] Returning 404 to user: Instance c80e99d1-9423-47b2-b602-c03b9019dc96 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:35.785455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e1850ad0-1fde-4e87-b140-66c65586c40d tempest-AttachVolumeTestJSON-1344976159 tempest-AttachVolumeTestJSON-1344976159-project] 10.222.0.67 "GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96" status: 404 len: 111 microversion: 2.1 time: 0.033590 May 31 15:19:35.787088 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 959/1906] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:19:35 2022] GET /compute/v2.1/servers/c80e99d1-9423-47b2-b602-c03b9019dc96 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:41.319979 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-08072dfc-e89d-4cfd-8aaf-4925fddaefc3 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Action: 'create', calling method: .version_select at 0x7f8dbf6bae50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-41311426"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:19:41.706636 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-08072dfc-e89d-4cfd-8aaf-4925fddaefc3 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.550477 May 31 15:19:41.707292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 948/1907] 10.222.0.67 () {60 vars in 1154 bytes} [Tue May 31 15:19:41 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 552 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 15:19:41.721099 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b784bbfb-5c66-4a7e-afac-0e6705505f23 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4fa550>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:41.785656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b784bbfb-5c66-4a7e-afac-0e6705505f23 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 200 len: 343 microversion: 2.1 time: 0.070432 May 31 15:19:41.786239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 960/1908] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 15:19:41 2022] GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:42.800494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fc31b226-5145-4091-a65f-e8222820062e tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc892f940>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:42.902290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fc31b226-5145-4091-a65f-e8222820062e tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 200 len: 344 microversion: 2.1 time: 0.107430 May 31 15:19:42.903493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 949/1909] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 15:19:42 2022] GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:42.925831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-97b18cb8-43a8-4ded-8897-36dad1a5d9e0 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Action: 'create', calling method: .version_select at 0x7f8dbf4d8c10>, body: {"snapshot": {"volume_id": "a277480e-b28c-45b5-bd5b-ab437cf6a099", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-881432621"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:19:43.227339 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-97b18cb8-43a8-4ded-8897-36dad1a5d9e0 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.314979 May 31 15:19:43.237823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 961/1910] 10.222.0.67 () {60 vars in 1161 bytes} [Tue May 31 15:19:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:43.243765 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cd5ad2e4-1542-45ee-9dea-2b1a1b091782 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc87ceb80>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:43.290910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cd5ad2e4-1542-45ee-9dea-2b1a1b091782 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.052262 May 31 15:19:43.291764 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 950/1911] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:43 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:19:43.305371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c9f56089-362e-4952-9b44-a4a44980e2c4 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4e79d0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:43.340135 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c9f56089-362e-4952-9b44-a4a44980e2c4 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039733 May 31 15:19:43.341141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 962/1912] 10.222.0.67 () {58 vars in 1139 bytes} [Tue May 31 15:19:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:43.355990 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-838485c9-08ea-4e9e-a22e-5ad93e6e58c3 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc886b310>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:43.417365 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-838485c9-08ea-4e9e-a22e-5ad93e6e58c3 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.067998 May 31 15:19:43.418624 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 951/1913] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:43 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:19:44.436528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e704b42f-d587-4cd0-88f6-93bd47372119 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf6ba160>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:44.474680 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e704b42f-d587-4cd0-88f6-93bd47372119 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.045771 May 31 15:19:44.475262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 963/1914] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:44 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:45.489528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aeeafe45-9cda-4db1-ac9b-661bb470a9b1 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf6baee0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:45.536232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aeeafe45-9cda-4db1-ac9b-661bb470a9b1 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.051873 May 31 15:19:45.536819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 952/1915] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:45 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:46.549658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1fa194e8-1a3f-4a57-8dd7-5fe89126dcf2 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4cc280>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:46.560564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:46.561363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:46.605222 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1fa194e8-1a3f-4a57-8dd7-5fe89126dcf2 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.058527 May 31 15:19:46.606601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 964/1916] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:46 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:47.619109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:47.622093 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:19:47.630486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ac0440f0-ebbd-4467-bcc3-ffd9e067cc8d tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc40ef670>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:47.708722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ac0440f0-ebbd-4467-bcc3-ffd9e067cc8d tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.090111 May 31 15:19:47.711845 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 953/1917] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:47 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:48.738895 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e60cf4bc-f583-4cba-ba06-59e5a85a3743 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc89635e0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:48.835313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e60cf4bc-f583-4cba-ba06-59e5a85a3743 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 287 microversion: 2.1 time: 0.109960 May 31 15:19:48.835920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 965/1918] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:48 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:48.861663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-63632a9e-dadc-4099-97db-7355ef4510a0 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf6baf70>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:49.056350 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-63632a9e-dadc-4099-97db-7355ef4510a0 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 202 len: 0 microversion: 2.1 time: 0.208489 May 31 15:19:49.065277 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 954/1919] 10.222.0.67 () {58 vars in 1253 bytes} [Tue May 31 15:19:48 2022] DELETE /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:19:49.074343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c1dd6aa3-997d-44a9-91bf-8db248aa2a7f tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf537f70>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:49.136718 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c1dd6aa3-997d-44a9-91bf-8db248aa2a7f tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 200 len: 286 microversion: 2.1 time: 0.070225 May 31 15:19:49.137545 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 966/1920] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:49 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:50.152950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-054ba327-a39f-49bd-8068-10c4e519d417 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc89348b0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:50.195439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-054ba327-a39f-49bd-8068-10c4e519d417 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] HTTP exception thrown: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-054ba327-a39f-49bd-8068-10c4e519d417 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Request method failure captured: May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 HTTP/1.1 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABiljIND_AIk60vbDpqoLX5LGMiKYD99_KCUkyhxpPzR9bKPoARkSDD9paQoyDBsKnd2NC_rIgMAn780RW3_dZmh1-a5dXHHBtfeofTAoZ_DWrdNynfdWd7oFfzDej8IPxGhGoF28rQNHHJW0XPdChJktFrQZRL6wTbGHJ2NRlxMaOOy8k May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:19:50.199531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3fca267681440049f30d28fe74370b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3fca267681440049f30d28fe74370b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 614d54ac37d743eea29632bf088e5e27 May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '924a55e2-89c3-443a-ada4-c9ab20fce164'} May 31 15:19:50.200859 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. (HTTP 404) (Request-ID: req-7728087e-ca05-430c-ba75-2bde7708826b) May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.201648 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:50.202725 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 31 15:19:50.203797 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. May 31 15:19:50.204853 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:50.206099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-054ba327-a39f-49bd-8068-10c4e519d417 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Returning 404 to user: Snapshot 924a55e2-89c3-443a-ada4-c9ab20fce164 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:50.207221 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-054ba327-a39f-49bd-8068-10c4e519d417 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164" status: 404 len: 111 microversion: 2.1 time: 0.059460 May 31 15:19:50.208357 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 955/1921] 10.222.0.67 () {58 vars in 1250 bytes} [Tue May 31 15:19:50 2022] GET /compute/v2.1/os-snapshots/924a55e2-89c3-443a-ada4-c9ab20fce164 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:19:50.217828 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-14c916b5-f12d-4151-a8e1-0063e973696d tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4e5940>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:50.320448 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-14c916b5-f12d-4151-a8e1-0063e973696d tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 202 len: 0 microversion: 2.1 time: 0.107501 May 31 15:19:50.321372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 967/1922] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 15:19:50 2022] DELETE /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 15:19:50.331941 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-913e7c81-208c-4e5d-a8c9-de7aa6a1f593 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc40ef160>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:50.425666 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-913e7c81-208c-4e5d-a8c9-de7aa6a1f593 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 200 len: 343 microversion: 2.1 time: 0.099065 May 31 15:19:50.428885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 956/1923] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 15:19:50 2022] GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:19:51.446682 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1034fc79-c5b0-4d17-bf48-efa86ba322e9 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4d8160>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:51.492986 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-1034fc79-c5b0-4d17-bf48-efa86ba322e9 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] HTTP exception thrown: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1034fc79-c5b0-4d17-bf48-efa86ba322e9 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Request method failure captured: May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 HTTP/1.1 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABiljIND_AIk60vbDpqoLX5LGMiKYD99_KCUkyhxpPzR9bKPoARkSDD9paQoyDBsKnd2NC_rIgMAn780RW3_dZmh1-a5dXHHBtfeofTAoZ_DWrdNynfdWd7oFfzDej8IPxGhGoF28rQNHHJW0XPdChJktFrQZRL6wTbGHJ2NRlxMaOOy8k May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:19:51.495797 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3fca267681440049f30d28fe74370b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3fca267681440049f30d28fe74370b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 614d54ac37d743eea29632bf088e5e27 May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'a277480e-b28c-45b5-bd5b-ab437cf6a099'} May 31 15:19:51.497205 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. (HTTP 404) (Request-ID: req-cf362a4d-0daf-4ca4-b281-8068d6cd0c22) May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.498056 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:51.499338 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 15:19:51.501214 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.503103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.505512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1034fc79-c5b0-4d17-bf48-efa86ba322e9 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Returning 404 to user: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:51.506616 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1034fc79-c5b0-4d17-bf48-efa86ba322e9 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 404 len: 109 microversion: 2.1 time: 0.069711 May 31 15:19:51.519227 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 968/1924] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 15:19:51 2022] GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:51.526257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2bda8850-1d3e-4195-8e4f-f384a2d36945 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dc414b0d0>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:51.566376 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-2bda8850-1d3e-4195-8e4f-f384a2d36945 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] HTTP exception thrown: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2bda8850-1d3e-4195-8e4f-f384a2d36945 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Request method failure captured: May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 HTTP/1.1 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABiljIND_AIk60vbDpqoLX5LGMiKYD99_KCUkyhxpPzR9bKPoARkSDD9paQoyDBsKnd2NC_rIgMAn780RW3_dZmh1-a5dXHHBtfeofTAoZ_DWrdNynfdWd7oFfzDej8IPxGhGoF28rQNHHJW0XPdChJktFrQZRL6wTbGHJ2NRlxMaOOy8k May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:19:51.569218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3fca267681440049f30d28fe74370b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3fca267681440049f30d28fe74370b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 614d54ac37d743eea29632bf088e5e27 May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'a277480e-b28c-45b5-bd5b-ab437cf6a099'} May 31 15:19:51.570369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. (HTTP 404) (Request-ID: req-d1ac2f52-8060-4ed4-a484-1d205cd30990) May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.571036 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 15:19:51.571962 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 15:19:51.573865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.574952 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:19:51.577572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2bda8850-1d3e-4195-8e4f-f384a2d36945 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Returning 404 to user: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:51.578523 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2bda8850-1d3e-4195-8e4f-f384a2d36945 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 404 len: 109 microversion: 2.1 time: 0.058155 May 31 15:19:51.579482 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 957/1925] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 15:19:51 2022] DELETE /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:19:51.589908 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e925a01-bb8e-45d8-9e4f-adedd91d3e97 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Calling method '.version_select at 0x7f8dbf4e5790>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:19:51.626615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-5e925a01-bb8e-45d8-9e4f-adedd91d3e97 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] HTTP exception thrown: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e925a01-bb8e-45d8-9e4f-adedd91d3e97 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Request method failure captured: May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 HTTP/1.1 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABiljIND_AIk60vbDpqoLX5LGMiKYD99_KCUkyhxpPzR9bKPoARkSDD9paQoyDBsKnd2NC_rIgMAn780RW3_dZmh1-a5dXHHBtfeofTAoZ_DWrdNynfdWd7oFfzDej8IPxGhGoF28rQNHHJW0XPdChJktFrQZRL6wTbGHJ2NRlxMaOOy8k May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:19:51.629798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3fca267681440049f30d28fe74370b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3fca267681440049f30d28fe74370b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3fca267681440049f30d28fe74370b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: a3fca267681440049f30d28fe74370b7 May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842065562 May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 614d54ac37d743eea29632bf088e5e27 May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842065562-project May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': 'a277480e-b28c-45b5-bd5b-ab437cf6a099'} May 31 15:19:51.630929 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. (HTTP 404) (Request-ID: req-4b0ac087-a2a2-4991-8318-b140102fc41e) May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.631559 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 15:19:51.632516 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 15:19:51.633414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5e925a01-bb8e-45d8-9e4f-adedd91d3e97 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] Returning 404 to user: Volume a277480e-b28c-45b5-bd5b-ab437cf6a099 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5e925a01-bb8e-45d8-9e4f-adedd91d3e97 tempest-VolumesSnapshotsTestJSON-842065562 tempest-VolumesSnapshotsTestJSON-842065562-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099" status: 404 len: 109 microversion: 2.1 time: 0.047873 May 31 15:19:51.635730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 969/1926] 10.222.0.67 () {58 vars in 1244 bytes} [Tue May 31 15:19:51 2022] GET /compute/v2.1/os-volumes/a277480e-b28c-45b5-bd5b-ab437cf6a099 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:19:51.894597 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4c0b869c-0027-439c-8b44-3b594d351a97 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Action: 'create', calling method: .version_select at 0x7f8dc40ef160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1926471896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGpbpjuLD/uhkdFNN2Jq3vPqQKK/FeK2uF2ZdwBSND2enLMkJyb0DShQdWeDNj/EAUse7H0vOtV6uaKg/GbdeRxkLhr4WmPZmIoYwqGWZBaRY1q3RVXfQy1dtiOtfLWiQ=="}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:19:51.914815 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-4c0b869c-0027-439c-8b44-3b594d351a97 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Getting quotas for project e24193a7426547f5895f8b8074e46875. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:19:51.921671 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-4c0b869c-0027-439c-8b44-3b594d351a97 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Getting quotas for user 6a8c202f3b4a424cb6565fc8a6abd15b and project e24193a7426547f5895f8b8074e46875. Resources: {'key_pairs'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:19:51.957235 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4c0b869c-0027-439c-8b44-3b594d351a97 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.334175 May 31 15:19:51.958309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 958/1927] 10.222.0.67 () {60 vars in 1158 bytes} [Tue May 31 15:19:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:20:04.452888 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:04.453404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:04.459808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:04.460253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:04.461031 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:04.461463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:04.485620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b0427d75-8d20-4aeb-96bc-910caddfc53c tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/ips" status: 200 len: 151 microversion: 2.1 time: 0.039451 May 31 15:20:04.486194 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 970/1928] 10.222.0.67 () {58 vars in 1247 bytes} [Tue May 31 15:20:04 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:20:05.845172 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=4 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:05.845921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:05.850727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb81ca50-7bc8-4f7b-a83e-f285645a7bf9"}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:05.851804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:05.860165 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:05.860734 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:05.861729 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:05.862111 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:06.131844 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eb3caa9a-bf9d-4fcf-8037-dfe1ef4247bb tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "POST /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287697 May 31 15:20:06.132463 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 959/1929] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 15:20:05 2022] POST /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:20:14.865544 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:14.866140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:14.868278 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:14.868948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=4 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:14.876052 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:14.876500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:14.877279 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:14.877717 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:14.969621 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lazy-loading 'services' on Instance uuid 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:20:15.071884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-02835a43-4169-47dd-a7db-9d2f65415354 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments/eb81ca50-7bc8-4f7b-a83e-f285645a7bf9" status: 202 len: 0 microversion: 2.1 time: 0.209559 May 31 15:20:15.072515 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 971/1930] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 15:20:14 2022] DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments/eb81ca50-7bc8-4f7b-a83e-f285645a7bf9 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:20:15.085017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:15.086132 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:15.094141 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:15.094610 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:15.095466 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:15.095910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:15.135134 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4371116e-0ec7-4fc4-8795-edfd6f35b8f9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055103 May 31 15:20:15.136651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 960/1931] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:20:15 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:20:16.151563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:16.153713 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:16.163577 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.164026 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.164813 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.165768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.201537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8692bc8f-563f-44af-affb-c120f250641b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055224 May 31 15:20:16.202035 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 972/1932] 10.222.0.67 () {58 vars in 1301 bytes} [Tue May 31 15:20:16 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 15:20:16.267953 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:16.268547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:16.275759 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.276220 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.277272 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.277703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.305543 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:20:16.397476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f84ee5f0-ce2b-4651-b2d2-33f862381d36 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 204 len: 0 microversion: 2.1 time: 0.133183 May 31 15:20:16.398072 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 961/1933] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:20:16 2022] DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:20:16.406884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:16.408049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:16.415102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.415489 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.416274 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:16.416714 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:16.572749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:16.580455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7225b5a4-c368-46a2-ab6d-b7a91ea69d47 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1684 microversion: 2.1 time: 0.177564 May 31 15:20:16.581025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 973/1934] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:16 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:17.353343 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1293666464", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1926471896", "security_groups": [{"name": "tempest-secgroup-smoke-2000049200"}], "networks": [{"uuid": "f79623d1-ad25-4df7-8322-94fdaf2ecccb"}], "block_device_mapping_v2": [{"uuid": "77650627-00c7-40c8-bc36-bf7cc032394e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:17.470216 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.network.neutron [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] validate_networks() for [('f79623d1-ad25-4df7-8322-94fdaf2ecccb', None, None, None, None, None)] {{(pid=124107) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:20:17.597371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:17.598167 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:17.605268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:17.605689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:17.606463 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:17.606930 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:17.827660 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:17.835592 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1c674ec8-ddcb-4834-a421-c2d69d71bf34 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1684 microversion: 2.1 time: 0.242082 May 31 15:20:17.840686 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 974/1935] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:17 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1684 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:17.938540 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Flavor limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:20:17.939006 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Image limits 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:20:17.939481 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Flavor pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:20:17.939899 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Image pref 0:0:0 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:20:17.940307 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.virt.hardware [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124107) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:20:17.950163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:17.950612 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:17.951440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:17.951879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:17.969789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Getting quotas for project e24193a7426547f5895f8b8074e46875. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:20:17.973774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.quota [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Getting quotas for user 6a8c202f3b4a424cb6565fc8a6abd15b and project e24193a7426547f5895f8b8074e46875. Resources: {'instances', 'ram', 'cores'} {{(pid=124107) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:20:18.038605 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Going to run 1 instances... {{(pid=124107) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:20:18.041000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77650627-00c7-40c8-bc36-bf7cc032394e',volume_size=None,volume_type=None)] {{(pid=124107) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:20:18.209982 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-3cd520b7-1c10-44dc-ba6f-aa545345ce63 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862075 May 31 15:20:18.211218 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 962/1936] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:20:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:20:18.224970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-41958246-a517-46c3-b15c-08ca620c496a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:18.225465 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-41958246-a517-46c3-b15c-08ca620c496a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:18.283581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-41958246-a517-46c3-b15c-08ca620c496a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:18.291372 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-41958246-a517-46c3-b15c-08ca620c496a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1089 microversion: 2.1 time: 0.070995 May 31 15:20:18.292046 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 975/1937] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:18 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:18.854675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:18.855649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:18.864878 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:18.865526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:18.866976 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:18.867602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:19.052002 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8df9e916ba4542af81e2a29229c1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34785f6d847ae8cb5be4e07d29c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:19.067599 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b048eab7-2623-43e3-9c08-477c494b023d tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 200 len: 1684 microversion: 2.1 time: 0.218230 May 31 15:20:19.070095 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 963/1938] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:18 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 1684 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:19.312503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fb411305-da5f-44df-829d-3afb9ab2d233 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:19.313253 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fb411305-da5f-44df-829d-3afb9ab2d233 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:19.393335 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-4d09fe43-d244-4bbb-8e93-dc7172541bee req-dbb03d0d-c3bb-4124-8b4c-bc6bd36b4406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a", "name": "network-vif-deleted", "tag": "83fb7c8e-f586-464a-a5ce-0ae7e6c5e170"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:19.408524 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4d09fe43-d244-4bbb-8e93-dc7172541bee req-dbb03d0d-c3bb-4124-8b4c-bc6bd36b4406 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:19.409698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-4d09fe43-d244-4bbb-8e93-dc7172541bee req-dbb03d0d-c3bb-4124-8b4c-bc6bd36b4406 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:19.452381 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fb411305-da5f-44df-829d-3afb9ab2d233 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:19.458372 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-4d09fe43-d244-4bbb-8e93-dc7172541bee req-dbb03d0d-c3bb-4124-8b4c-bc6bd36b4406 service nova] Creating event network-vif-deleted:83fb7c8e-f586-464a-a5ce-0ae7e6c5e170 for instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a on hv-cinder-83979 May 31 15:20:19.460978 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fb411305-da5f-44df-829d-3afb9ab2d233 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1089 microversion: 2.1 time: 0.155697 May 31 15:20:19.462496 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 976/1939] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:19 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1089 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:19.466897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-4d09fe43-d244-4bbb-8e93-dc7172541bee req-dbb03d0d-c3bb-4124-8b4c-bc6bd36b4406 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077168 May 31 15:20:19.466897 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 964/1940] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:20:20.093391 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:20.094129 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:20.101885 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:20.102423 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:20.103925 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:20.104402 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:20.120809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a HTTP/1.1 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:20:20.122537 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:20.124560 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a'} May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:20.126018 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:20.127724 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:20.128857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:20.128857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ea34d81c-430b-4b70-9364-f2f74642a224 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 404 len: 111 microversion: 2.1 time: 0.039196 May 31 15:20:20.128857 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 965/1941] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:20 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:20:20.135503 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4f52f704-134c-49ae-99a5-35526d22af54 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '.version_select at 0x7f8dbf4e5dc0>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:20.157658 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4f52f704-134c-49ae-99a5-35526d22af54 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693065005" status: 202 len: 0 microversion: 2.1 time: 0.026160 May 31 15:20:20.158568 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 977/1942] 10.222.0.67 () {58 vars in 1220 bytes} [Tue May 31 15:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693065005 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:20:20.481254 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bb782f2e-49b1-4823-914d-0f47cd6e2a2a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:20.481892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bb782f2e-49b1-4823-914d-0f47cd6e2a2a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:20.592193 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bb782f2e-49b1-4823-914d-0f47cd6e2a2a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:20.599356 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bb782f2e-49b1-4823-914d-0f47cd6e2a2a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1089 microversion: 2.1 time: 0.123530 May 31 15:20:20.600519 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 966/1943] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:20 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:21.627402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f05d79e8-4d79-4328-868e-3c6b86c4922a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:21.628015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f05d79e8-4d79-4328-868e-3c6b86c4922a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:21.702345 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f05d79e8-4d79-4328-868e-3c6b86c4922a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:21.712656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f05d79e8-4d79-4328-868e-3c6b86c4922a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1089 microversion: 2.1 time: 0.099714 May 31 15:20:21.713751 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 978/1944] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:21 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1089 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:22.420876 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:22.421459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:22.428977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.429444 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.430208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.431179 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.445358 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a HTTP/1.1 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:20:22.447603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.448872 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a'} May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:22.452849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.454199 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:22.455548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:22.455548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-7bd4fc16-43a5-4a2b-81b9-0e4449e1655b tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 404 len: 111 microversion: 2.1 time: 0.032214 May 31 15:20:22.455548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 967/1945] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:20:22 2022] DELETE /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:20:22.457922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:22.458537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:22.465064 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.465512 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.466297 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.466772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.482423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a HTTP/1.1 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:20:22.484580 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.485977 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a'} May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:22.486638 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. May 31 15:20:22.487793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:22.489820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:22.490910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3453cad8-2d08-4c56-92a2-f21bf77604a9 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a" status: 404 len: 111 microversion: 2.1 time: 0.036843 May 31 15:20:22.491676 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 979/1946] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:22 2022] GET /compute/v2.1/servers/89ba4764-d2c8-4ac4-aa0d-7cdbc1100d0a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 15:20:22.737415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:22.738266 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:22.746175 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.746727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.747588 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:22.748224 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:22.818013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:22.825916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0286a885-bf10-4dfd-a8c4-40396f7edea2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1139 microversion: 2.1 time: 0.092317 May 31 15:20:22.828531 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 968/1947] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:22 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:23.684819 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:23.685938 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:23.693132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.693820 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.694886 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.695342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.715023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 HTTP/1.1 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:20:23.716608 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.717950 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '4c1632c3-9777-4687-85df-676c6d678852'} May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:23.722065 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.723360 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:23.724583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:23.724583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ca960111-532c-4486-ac30-d756cb96a99e tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 404 len: 111 microversion: 2.1 time: 0.037858 May 31 15:20:23.724583 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 980/1948] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:20:23 2022] DELETE /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:20:23.729812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:23.731028 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 4c1632c3-9777-4687-85df-676c6d678852] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:23.743910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.744727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.746106 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.746956 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.774181 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 HTTP/1.1 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:20:23.777535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.778752 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': '4c1632c3-9777-4687-85df-676c6d678852'} May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:23.779459 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. May 31 15:20:23.780663 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:20:23.782284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 4c1632c3-9777-4687-85df-676c6d678852 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:23.782284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d020eb6b-0929-4c6d-b270-28457b4b6b40 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852" status: 404 len: 111 microversion: 2.1 time: 0.056557 May 31 15:20:23.782284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 969/1949] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:23 2022] GET /compute/v2.1/servers/4c1632c3-9777-4687-85df-676c6d678852 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:20:23.843934 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:23.854906 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:23.867202 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.867814 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.869366 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:23.871645 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:23.994630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:24.006602 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3d90614e-3e6f-4b08-abed-e1251960ee53 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1205 microversion: 2.1 time: 0.166375 May 31 15:20:24.007421 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 981/1950] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:23 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1205 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:25.026911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:25.028284 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:25.036468 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.037166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.038429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.038992 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.049811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:25.050604 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:25.060521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.061459 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.063072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.063586 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.085180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: DELETE /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 HTTP/1.1 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:20:25.087780 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.089283 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '3d3f067e-4a88-4f16-aca3-284ecab21200'} May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:25.090057 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.091336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.094425 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:25.095555 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-255f238e-178b-47f4-b6c4-607f7da63bc5 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 404 len: 111 microversion: 2.1 time: 0.054011 May 31 15:20:25.096323 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 982/1951] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:20:25 2022] DELETE /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:20:25.107531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:25.108138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] [instance: 3d3f067e-4a88-4f16-aca3-284ecab21200] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:25.114877 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.115313 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.116273 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.116892 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.186532 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] HTTP exception thrown: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Request method failure captured: May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 HTTP/1.1 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABili3_xONXUH0Lblk1tjxnzJXZnDs83GQNYmFJAXNfpSSImbCHRCexp2tT8wjMNfvnO4B3obOAncdM6DNtb5wO96vW0i2JB702DWc5k976Gr7mtlmY9Rkjxq-llgMeA-CJbz0adZHdY_PR7Qiz5nDlEoUvQ1vdBvmWXH11qPjweBwlb24 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:20:25.193335 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5bd34785f6d847ae8cb5be4e07d29c38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: 5bd34785f6d847ae8cb5be4e07d29c38 May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1170093542 May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 7a8df9e916ba4542af81e2a29229c1db May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-AttachVolumeNegativeTest-1170093542-project May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.194417 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '3d3f067e-4a88-4f16-aca3-284ecab21200'} May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:20:25.195225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. May 31 15:20:25.196831 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:20:25.197700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] Returning 404 to user: Instance 3d3f067e-4a88-4f16-aca3-284ecab21200 could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:20:25.197700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e472caed-6372-40b5-bc6b-ec9704f00695 tempest-AttachVolumeNegativeTest-1170093542 tempest-AttachVolumeNegativeTest-1170093542-project] 10.222.0.67 "GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200" status: 404 len: 111 microversion: 2.1 time: 0.092266 May 31 15:20:25.198620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 983/1952] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:25 2022] GET /compute/v2.1/servers/3d3f067e-4a88-4f16-aca3-284ecab21200 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:20:25.216682 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:25.228245 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ecaf4601-89e6-4d23-9d61-5553af804f71 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.206569 May 31 15:20:25.228950 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 970/1953] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:25 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:25.370149 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-aa3865d1-9e03-43ed-bcb0-73f562580ca4 req-0c51d8cb-7755-473f-942b-e55b372bed31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:25.380086 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-aa3865d1-9e03-43ed-bcb0-73f562580ca4 req-0c51d8cb-7755-473f-942b-e55b372bed31 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:25.380667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-aa3865d1-9e03-43ed-bcb0-73f562580ca4 req-0c51d8cb-7755-473f-942b-e55b372bed31 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:25.405514 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-aa3865d1-9e03-43ed-bcb0-73f562580ca4 req-0c51d8cb-7755-473f-942b-e55b372bed31 service nova] Creating event network-changed:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:20:25.411042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-aa3865d1-9e03-43ed-bcb0-73f562580ca4 req-0c51d8cb-7755-473f-942b-e55b372bed31 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045078 May 31 15:20:25.411948 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 984/1954] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:20:26.245719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:26.246279 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:26.253650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:26.253650 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:26.254455 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:26.254827 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:26.413740 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:26.422546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c7870077-d318-43af-907e-0babb87f2469 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.180801 May 31 15:20:26.428834 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 971/1955] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:26 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:27.450593 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:27.454144 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:27.460852 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:27.461420 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:27.463499 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:27.463955 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:27.605433 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:27.613282 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ccd7b880-1402-4f8e-b351-640de1da129a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.172752 May 31 15:20:27.613878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 985/1956] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:27 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:28.631651 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:28.632393 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:28.635010 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:28.640722 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:28.641186 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:28.642160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:28.642607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:28.828719 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:28.842354 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-713bab99-aef1-4d8c-a37c-668e40ac34e0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.215425 May 31 15:20:28.843847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 972/1957] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:28 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:29.870970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:29.871805 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:29.878768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:29.879268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:29.884912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:29.884912 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:30.120993 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:30.135268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-665c5305-c9b2-4ae7-9e56-fe1e4dbc8a67 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.268747 May 31 15:20:30.136213 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 986/1958] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:29 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:31.160860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:31.162882 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:31.165639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=8 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:31.172742 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:31.173349 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:31.174237 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:31.174796 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:31.370486 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:31.382630 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-bacb83f5-459f-49bc-9b40-2fb8548df4e7 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.228486 May 31 15:20:31.384654 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 973/1959] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:31 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:32.407588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:32.409624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:32.413997 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:32.424020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:32.424775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:32.426141 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:32.426964 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:32.642308 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:32.650792 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7df8304c-e339-4c4f-a783-9bc0a102ef51 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.249868 May 31 15:20:32.666909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 987/1960] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:32 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:33.677217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:33.678568 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:33.689375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:33.691323 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:33.692749 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:33.693641 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:33.927187 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:33.936457 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a06e3e70-982e-4a54-84bd-42d1d87421cd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.266857 May 31 15:20:33.937375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 974/1961] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:33 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:34.960379 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:34.963023 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:34.973894 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:34.974782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:34.976080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:34.976891 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:35.175118 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:35.190983 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-16ac7186-c415-40ef-b741-e7673d2175f3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.239228 May 31 15:20:35.192073 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 988/1962] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:34 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:36.209100 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:36.210602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:36.214810 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:36.220688 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:36.221150 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:36.221978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:36.222424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:36.226296 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:36.412833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:36.425635 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ec8b5267-9bae-4a46-bae3-3faa5b5f5780 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.220369 May 31 15:20:36.426683 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 975/1963] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:36 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:37.453810 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:37.454933 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:37.466320 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:37.467102 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:37.468392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:37.469119 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:37.667918 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:37.687452 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b427968a-c4e7-4068-908d-19fecfb70e8c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.239926 May 31 15:20:37.688959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 989/1964] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:37 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:38.713230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:38.714375 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:38.721520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:38.722099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:38.723044 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:38.723786 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:38.894319 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:38.904102 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-197cb9b4-d244-4704-99d5-a6e94adf6647 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.199212 May 31 15:20:38.904879 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 976/1965] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:38 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:39.922677 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:39.923587 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:39.930936 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:39.931383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:39.932378 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:39.932994 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:40.127624 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:40.137920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-7c94265b-9461-4f11-b90e-fdf045be31e5 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.219085 May 31 15:20:40.138752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 990/1966] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:39 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:41.165035 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:41.166442 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:41.177892 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:41.178670 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:41.180053 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:41.180806 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:41.413910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:41.434750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d9d4af7-3306-417a-817a-4b5e17dad93e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.278096 May 31 15:20:41.435948 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 977/1967] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:41 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:42.465474 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:42.466768 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:42.476342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:42.477414 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:42.478640 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:42.479125 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:42.820131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:42.832461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5205a0ce-c554-4089-8861-c8b1ca4e2140 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.375818 May 31 15:20:42.833112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 991/1968] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:42 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:43.854398 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:43.855345 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:43.862474 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:43.862983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:43.863779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:43.864234 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:44.018232 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:44.027073 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-036ccfb6-cd3f-47e7-b3de-66081984df28 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.179410 May 31 15:20:44.027831 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 978/1969] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:43 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:45.046154 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:45.047180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:45.049612 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:45.058012 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:45.058806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:45.060173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:45.060775 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:45.065024 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:20:45.234246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:45.243084 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-002d5a02-d9d2-475f-aa32-aaf6cf2dae41 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.201219 May 31 15:20:45.243740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 992/1970] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:45 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:45.444711 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-c94a0f09-dd16-44ac-9838-11623020c483 req-802d5f70-391c-43b1-8512-72f2f22babd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "name": "network-vif-plugged", "status": "completed", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:45.456664 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-c94a0f09-dd16-44ac-9838-11623020c483 req-802d5f70-391c-43b1-8512-72f2f22babd2 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:45.457424 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-c94a0f09-dd16-44ac-9838-11623020c483 req-802d5f70-391c-43b1-8512-72f2f22babd2 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:45.472302 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-c94a0f09-dd16-44ac-9838-11623020c483 req-802d5f70-391c-43b1-8512-72f2f22babd2 service nova] Creating event network-vif-plugged:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:20:45.479283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-c94a0f09-dd16-44ac-9838-11623020c483 req-802d5f70-391c-43b1-8512-72f2f22babd2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038437 May 31 15:20:45.480113 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 979/1971] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:20:46.260411 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:46.261011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:46.268210 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:46.268665 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:46.269468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:46.269917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:46.416455 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:46.426365 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-548a4d53-ed7b-4792-aa85-4a1e360abd6c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.169930 May 31 15:20:46.426999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 993/1972] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:46 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:47.445791 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:47.446441 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:47.453299 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:47.453757 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:47.454538 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:47.455017 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:47.602192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:47.610311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cfed946a-6436-4e64-af52-b448f01967ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.169282 May 31 15:20:47.610966 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 980/1973] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:47 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:48.630485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:48.631772 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:48.640904 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:48.641470 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:48.642471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:48.643054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:48.818262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:48.826605 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-76d3f0a9-f96c-4572-9b06-3a4600ec0531 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1261 microversion: 2.1 time: 0.202716 May 31 15:20:48.827247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 994/1974] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:48 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:20:49.844762 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:49.845324 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:49.852901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:49.853415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:49.854564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:49.855116 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:50.034789 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:50.046514 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-73fbce40-9c17-4f45-ae44-b315c4ee36ce tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1446 microversion: 2.1 time: 0.205829 May 31 15:20:50.047228 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 981/1975] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:49 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:50.068847 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:20:50.069917 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:20:50.083071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:50.083815 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:50.085105 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:50.085830 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:50.267925 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:20:50.281754 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d12fb7f2-6f5b-4164-acea-3b4071c038bf tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1446 microversion: 2.1 time: 0.219772 May 31 15:20:50.283041 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 995/1976] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:20:50 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:20:52.742920 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-17b7fb37-1478-4617-af55-6cd2065853e9 req-cd4cfa57-5034-4dfe-84a0-0e9b516321a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:20:52.752535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-17b7fb37-1478-4617-af55-6cd2065853e9 req-cd4cfa57-5034-4dfe-84a0-0e9b516321a0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:20:52.753281 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-17b7fb37-1478-4617-af55-6cd2065853e9 req-cd4cfa57-5034-4dfe-84a0-0e9b516321a0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:20:52.766169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-17b7fb37-1478-4617-af55-6cd2065853e9 req-cd4cfa57-5034-4dfe-84a0-0e9b516321a0 service nova] Creating event network-changed:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:20:52.771977 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-17b7fb37-1478-4617-af55-6cd2065853e9 req-cd4cfa57-5034-4dfe-84a0-0e9b516321a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 May 31 15:20:52.773155 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 982/1977] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:21:16.745528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-279066532", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "networks": [{"uuid": "fb9e3544-5e9c-4a73-81dc-c0a4205e8bc1"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:21:16.753804 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=7 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:16.754822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=23 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:16.807962 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] validate_networks() for [('fb9e3544-5e9c-4a73-81dc-c0a4205e8bc1', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:21:17.363431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:21:17.363940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:21:17.364536 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:21:17.365021 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:21:17.365506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:21:17.377054 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:17.377418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:17.378221 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:17.378674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:17.397693 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Getting quotas for project 2dac67cb14e24c41b4add3b40a103fea. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:21:17.402484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Getting quotas for user 65894910ee8647f7b32395c0017d3562 and project 2dac67cb14e24c41b4add3b40a103fea. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:21:17.415020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:21:17.417340 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:21:17.467811 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a35847a1-215b-43b2-9250-51bd930cd862 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725886 May 31 15:21:17.468564 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 996/1978] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:21:17.477460 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=15 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:17.479534 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=39 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:17.485672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2dafe722-9dbd-422e-9115-ac5ec6871812 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:17.486395 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2dafe722-9dbd-422e-9115-ac5ec6871812 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:17.547916 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-2dafe722-9dbd-422e-9115-ac5ec6871812 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:17.555674 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2dafe722-9dbd-422e-9115-ac5ec6871812 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1218 microversion: 2.1 time: 0.080570 May 31 15:21:17.556327 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 983/1979] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:17 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:18.573249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:18.576019 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:18.584556 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:18.585712 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:18.586538 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:18.587015 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:18.666500 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:18.674667 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-133cb2c6-271b-463e-bd26-1002d0e49ef6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1276 microversion: 2.1 time: 0.105428 May 31 15:21:18.675272 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 997/1980] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:18 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:19.691768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:19.692392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:19.699698 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:19.700160 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:19.700942 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:19.701388 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:19.903684 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:19.912264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-52c34e88-3bdc-4fab-9634-d4ddd48395ba tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.224326 May 31 15:21:19.921517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 984/1981] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:19 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:19.954422 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-0d232dd2-235d-4f84-b8a9-9d5f3b11f6c8 req-266ca0d6-e84f-4014-b044-d0a86c1947a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf6599c-0c82-4310-8b3b-aa8449e760ae", "tag": "1118bfd6-915e-4554-875d-fcb7a078e412"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:21:19.966033 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-0d232dd2-235d-4f84-b8a9-9d5f3b11f6c8 req-266ca0d6-e84f-4014-b044-d0a86c1947a1 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:19.966528 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-0d232dd2-235d-4f84-b8a9-9d5f3b11f6c8 req-266ca0d6-e84f-4014-b044-d0a86c1947a1 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:19.987457 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-0d232dd2-235d-4f84-b8a9-9d5f3b11f6c8 req-266ca0d6-e84f-4014-b044-d0a86c1947a1 service nova] Creating event network-changed:1118bfd6-915e-4554-875d-fcb7a078e412 for instance aaf6599c-0c82-4310-8b3b-aa8449e760ae on hv-cinder-83979 May 31 15:21:19.993506 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-0d232dd2-235d-4f84-b8a9-9d5f3b11f6c8 req-266ca0d6-e84f-4014-b044-d0a86c1947a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042887 May 31 15:21:19.994924 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 998/1982] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:21:20.929253 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:20.930726 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:20.937016 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:20.937494 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:20.938264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:20.938744 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:21.073097 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:21.080574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0b16ce20-c582-4cb3-87df-3960efd3940c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.155292 May 31 15:21:21.081138 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 985/1983] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:20 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:22.098404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:22.099121 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:22.105418 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:22.105869 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:22.106628 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:22.107138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:22.240404 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:22.248289 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1f162a13-1304-41ab-95a3-0d80f52b7d8e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.154596 May 31 15:21:22.248845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 999/1984] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:22 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:23.265489 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:23.266112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:23.272407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:23.272866 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:23.273647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:23.274091 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:23.416347 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:23.424239 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-557c23ca-8088-43ac-9cbe-937f0234893a tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.162791 May 31 15:21:23.424813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 986/1985] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:23 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:24.441243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:24.441939 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:24.448380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:24.448935 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:24.449699 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:24.450138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:24.594656 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:24.608719 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f06d8897-3199-4063-a39c-e9d27be839eb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.171142 May 31 15:21:24.609745 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1000/1986] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:24 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:25.638904 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:25.639517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:25.646592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:25.647074 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:25.647909 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:25.648451 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:25.784197 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:25.792333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-38700e21-391f-406f-9381-697bc3af8cb3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.163852 May 31 15:21:25.792923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 987/1987] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:25 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:26.593595 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-a4a4ebec-f917-4a97-95d7-919823e9824c req-4ec61565-d47f-40c8-90f5-e96508659250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf6599c-0c82-4310-8b3b-aa8449e760ae", "name": "network-vif-plugged", "status": "completed", "tag": "1118bfd6-915e-4554-875d-fcb7a078e412"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:21:26.602443 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-a4a4ebec-f917-4a97-95d7-919823e9824c req-4ec61565-d47f-40c8-90f5-e96508659250 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:26.602913 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-a4a4ebec-f917-4a97-95d7-919823e9824c req-4ec61565-d47f-40c8-90f5-e96508659250 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:26.613883 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-a4a4ebec-f917-4a97-95d7-919823e9824c req-4ec61565-d47f-40c8-90f5-e96508659250 service nova] Creating event network-vif-plugged:1118bfd6-915e-4554-875d-fcb7a078e412 for instance aaf6599c-0c82-4310-8b3b-aa8449e760ae on hv-cinder-83979 May 31 15:21:26.618919 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-a4a4ebec-f917-4a97-95d7-919823e9824c req-4ec61565-d47f-40c8-90f5-e96508659250 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 May 31 15:21:26.619654 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1001/1988] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:21:26.808828 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:26.809591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:26.816262 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:26.816802 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:26.817649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:26.818163 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:26.947566 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:26.955161 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-06252c09-954b-49b6-9267-9c9da0ac69f4 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.150782 May 31 15:21:26.955732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 988/1989] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:26 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:27.974138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:27.974893 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:27.976909 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:27.977585 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:27.984294 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:27.984750 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:27.985531 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:27.985970 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:28.117009 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:28.126215 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-f6cfd4c9-0074-411b-ba04-59c47d1ca507 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1318 microversion: 2.1 time: 0.157094 May 31 15:21:28.126821 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1002/1990] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:27 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:21:29.143803 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:21:29.144421 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:29.146397 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:29.153064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:29.153528 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:29.154309 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:29.154779 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:29.288621 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:21:29.296499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-80b5410e-417e-4114-9e1f-19803cf1c1b3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1508 microversion: 2.1 time: 0.156619 May 31 15:21:29.297084 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 989/1991] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:21:29 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:21:57.081113 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4c4ed33-aa94-48ef-aed7-6c8edc19c5f2", "device": "/dev/sdb"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:21:57.082749 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:21:57.084954 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:57.085782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=30 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:21:57.093405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:57.093897 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:57.094732 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:21:57.095246 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:21:57.342146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-3cd121e7-9f9c-480d-b8ea-43520beafc12 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "POST /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264843 May 31 15:21:57.342740 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1003/1992] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 15:21:57 2022] POST /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:22:05.519238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:22:05.519847 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:22:25.246590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:25.247230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:25.249143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=16 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:25.249849 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=36 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:25.256303 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:25.256758 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:25.257563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:25.258008 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:25.338247 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lazy-loading 'services' on Instance uuid aaf6599c-0c82-4310-8b3b-aa8449e760ae {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:22:25.408501 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-aee2da1c-9c21-404d-8041-44d319da0ab3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae/os-volume_attachments/d4c4ed33-aa94-48ef-aed7-6c8edc19c5f2" status: 202 len: 0 microversion: 2.1 time: 0.165977 May 31 15:22:25.409090 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 990/1993] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 15:22:25 2022] DELETE /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae/os-volume_attachments/d4c4ed33-aa94-48ef-aed7-6c8edc19c5f2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:22:26.521807 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:26.522581 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:26.527281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:26.527858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:26.535195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:26.535639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:26.536390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:26.536822 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:26.565353 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:22:26.640333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-de300da9-2950-4dea-aee6-488bdaf6ee10 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 204 len: 0 microversion: 2.1 time: 0.119724 May 31 15:22:26.644300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1004/1994] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:22:26 2022] DELETE /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:22:26.650264 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:26.650984 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:26.658492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:26.659005 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:26.659798 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:26.660292 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:26.805592 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:26.813007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d00dccb2-4bab-4971-b9b2-6bedfc5ee60c tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1514 microversion: 2.1 time: 0.167472 May 31 15:22:26.813570 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 991/1995] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:26 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:27.830662 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:27.831368 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:27.838011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:27.838406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:27.839217 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:27.839659 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:27.970527 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:27.977937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-b384b496-e745-44f0-9cd1-f0c7e30ec480 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1514 microversion: 2.1 time: 0.151562 May 31 15:22:27.978502 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1005/1996] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:27 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:28.994639 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:28.995289 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:29.002668 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:29.003137 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:29.003923 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:29.004368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:29.272229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:29.280432 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9a39b385-ce8b-47d7-bca9-6dde7ab194e5 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 200 len: 1514 microversion: 2.1 time: 0.289620 May 31 15:22:29.281123 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 992/1997] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:28 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:29.395138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-e0332ded-8031-482f-b2f0-bb51a2ea49b6 req-b343da0a-af18-4fd2-b756-025cbd37718f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf6599c-0c82-4310-8b3b-aa8449e760ae", "name": "network-vif-deleted", "tag": "1118bfd6-915e-4554-875d-fcb7a078e412"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:22:29.404620 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-e0332ded-8031-482f-b2f0-bb51a2ea49b6 req-b343da0a-af18-4fd2-b756-025cbd37718f service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:29.405337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-e0332ded-8031-482f-b2f0-bb51a2ea49b6 req-b343da0a-af18-4fd2-b756-025cbd37718f service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:29.417254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-e0332ded-8031-482f-b2f0-bb51a2ea49b6 req-b343da0a-af18-4fd2-b756-025cbd37718f service nova] Creating event network-vif-deleted:1118bfd6-915e-4554-875d-fcb7a078e412 for instance aaf6599c-0c82-4310-8b3b-aa8449e760ae on hv-cinder-83979 May 31 15:22:29.423077 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-e0332ded-8031-482f-b2f0-bb51a2ea49b6 req-b343da0a-af18-4fd2-b756-025cbd37718f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 May 31 15:22:29.423674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1006/1998] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:22:30.297392 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:30.298009 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: aaf6599c-0c82-4310-8b3b-aa8449e760ae] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:30.304590 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:30.305045 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:30.305821 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:30.306260 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:30.320208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] HTTP exception thrown: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Request method failure captured: May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae HTTP/1.1 May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABiljJqv7wt12vfhy8sukQm0SrqUY4NFkLTA2KqiVYEThjpcmmZ64ewCTy4rueiplWxS7Jk5SulP3FIYtwdSJEmB6FYUokukgf6pg4P7qddakgjisW2PF4WP8-fED9n7qKvUD35GcUP8BSqUDKYCDFcd-DuH5L_3zyiNRZ3cMun1EDar4o May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 2dac67cb14e24c41b4add3b40a103fea May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:22:30.321862 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 2dac67cb14e24c41b4add3b40a103fea May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesSnapshotTestJSON-23317063-project May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 65894910ee8647f7b32395c0017d3562 May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesSnapshotTestJSON-23317063-project May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. May 31 15:22:30.323384 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'aaf6599c-0c82-4310-8b3b-aa8449e760ae'} May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:22:30.324205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. May 31 15:22:30.325921 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:22:30.326983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Returning 404 to user: Instance aaf6599c-0c82-4310-8b3b-aa8449e760ae could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:22:30.326983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-fb3b773d-a4ff-45c5-98dd-8f9dd5ba0ff6 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae" status: 404 len: 111 microversion: 2.1 time: 0.029853 May 31 15:22:30.326983 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 993/1999] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:30 2022] GET /compute/v2.1/servers/aaf6599c-0c82-4310-8b3b-aa8449e760ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:22:43.268091 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:43.268884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:43.273139 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-877105640", "imageRef": "bc008f26-f3a9-4e5d-9edf-ab3b04a20341", "flavorRef": "452", "networks": [{"uuid": "fb9e3544-5e9c-4a73-81dc-c0a4205e8bc1"}]}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:22:43.326398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.network.neutron [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] validate_networks() for [('fb9e3544-5e9c-4a73-81dc-c0a4205e8bc1', None, None, None, None, None)] {{(pid=124106) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 15:22:43.681684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Flavor limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 15:22:43.682100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Image limits 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 15:22:43.682563 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Flavor pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 15:22:43.682989 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Image pref 0:0:0 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 15:22:43.683392 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.virt.hardware [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124106) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 15:22:43.692700 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:43.693138 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:43.693919 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:43.694347 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:43.710380 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Getting quotas for project 2dac67cb14e24c41b4add3b40a103fea. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 15:22:43.714146 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.quota [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Getting quotas for user 65894910ee8647f7b32395c0017d3562 and project 2dac67cb14e24c41b4add3b40a103fea. Resources: {'instances', 'ram', 'cores'} {{(pid=124106) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 15:22:43.727823 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Going to run 1 instances... {{(pid=124106) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 15:22:43.730185 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc008f26-f3a9-4e5d-9edf-ab3b04a20341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124106) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 15:22:43.783195 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-dcedc5e0-4df7-4375-bd79-92428aa7f4d3 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516502 May 31 15:22:43.783843 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1007/2000] 10.222.0.67 () {60 vars in 1146 bytes} [Tue May 31 15:22:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 15:22:43.794731 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-24f3e3c5-3210-4a1d-89bb-c9657d743226 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:43.795355 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-24f3e3c5-3210-4a1d-89bb-c9657d743226 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:43.797902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=8 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:43.798813 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:43.854809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-24f3e3c5-3210-4a1d-89bb-c9657d743226 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:43.862089 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-24f3e3c5-3210-4a1d-89bb-c9657d743226 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1218 microversion: 2.1 time: 0.072169 May 31 15:22:43.862675 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 994/2001] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:43 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:44.880707 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:44.881168 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:44.890254 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:44.890752 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:44.891543 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:44.891985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:44.984336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:44.991798 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-fac86a89-c4b1-4195-a54f-84aac5172460 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1276 microversion: 2.1 time: 0.116769 May 31 15:22:44.992371 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1008/2002] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:44 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:46.011546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:46.013192 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:46.014263 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-9615c80a-007f-4b6f-90fa-711680b74337 req-8218c6f6-a16d-4b8c-b063-a8c22279c1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc6681e-ae8f-4a27-8e09-25e7f7f3c713", "tag": "43914b89-2158-4614-a950-392c12c4f4ed"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:22:46.027607 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:46.029427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:46.030298 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-9615c80a-007f-4b6f-90fa-711680b74337 req-8218c6f6-a16d-4b8c-b063-a8c22279c1ae service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:46.030434 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:46.031454 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:46.031601 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-9615c80a-007f-4b6f-90fa-711680b74337 req-8218c6f6-a16d-4b8c-b063-a8c22279c1ae service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:46.058519 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-9615c80a-007f-4b6f-90fa-711680b74337 req-8218c6f6-a16d-4b8c-b063-a8c22279c1ae service nova] Creating event network-changed:43914b89-2158-4614-a950-392c12c4f4ed for instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 on hv-cinder-83979 May 31 15:22:46.067008 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-9615c80a-007f-4b6f-90fa-711680b74337 req-8218c6f6-a16d-4b8c-b063-a8c22279c1ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058987 May 31 15:22:46.068286 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1009/2003] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:22:46.263889 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:46.271533 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-0a43b440-b1ca-446d-9a94-d33aa74a4dc9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.266106 May 31 15:22:46.272109 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 995/2004] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:46 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:47.289600 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:47.290277 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:47.296884 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:47.297337 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:47.298100 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:47.298537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:47.425758 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:47.433132 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-d3b5663a-ec09-4f94-8b49-8c9867e31990 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.148391 May 31 15:22:47.433704 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1010/2005] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:47 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:48.450600 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:48.451178 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:48.457667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:48.458112 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:48.458903 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:48.459340 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:48.585064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:48.592428 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-a25b0669-0d6f-4d26-8b3c-5959ee65e002 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.146392 May 31 15:22:48.592989 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 996/2006] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:48 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:49.609128 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:49.609881 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:49.616423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:49.616878 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:49.617643 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:49.618087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:49.769104 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:49.778171 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a1e7fce0-9a09-4625-9cee-69eab4b6fbec tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.172916 May 31 15:22:49.778762 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1011/2007] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:49 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:50.794945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:50.795564 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:50.802046 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:50.802503 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:50.803334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:50.803781 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:50.935075 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:50.942547 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f77a1feb-3f97-46c1-ba04-dc3d5efef7c9 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.151501 May 31 15:22:50.943143 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 997/2008] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:50 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:51.266316 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-5a856115-fb9e-4ae3-9682-05b742f49c0f req-4af83fc1-b2e8-4749-80f2-bd7dfe1a9edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6681e-ae8f-4a27-8e09-25e7f7f3c713", "name": "network-vif-plugged", "status": "completed", "tag": "43914b89-2158-4614-a950-392c12c4f4ed"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:22:51.275243 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-5a856115-fb9e-4ae3-9682-05b742f49c0f req-4af83fc1-b2e8-4749-80f2-bd7dfe1a9edb service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:51.275694 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-5a856115-fb9e-4ae3-9682-05b742f49c0f req-4af83fc1-b2e8-4749-80f2-bd7dfe1a9edb service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:51.288228 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-5a856115-fb9e-4ae3-9682-05b742f49c0f req-4af83fc1-b2e8-4749-80f2-bd7dfe1a9edb service nova] Creating event network-vif-plugged:43914b89-2158-4614-a950-392c12c4f4ed for instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 on hv-cinder-83979 May 31 15:22:51.293126 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-5a856115-fb9e-4ae3-9682-05b742f49c0f req-4af83fc1-b2e8-4749-80f2-bd7dfe1a9edb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030756 May 31 15:22:51.294540 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1012/2009] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:22:51.959101 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:51.959702 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:51.966115 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:51.966575 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:51.967380 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:51.967823 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:52.099714 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:52.107855 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-873ea27b-e8a2-4522-a466-8504eac81138 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.152638 May 31 15:22:52.108420 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 998/2010] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:51 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:53.126109 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:53.126837 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:53.133131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:53.133588 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:53.134405 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:53.134825 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:53.269606 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:53.277343 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a046cf45-1594-4324-ac18-07cdb2cd912e tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1318 microversion: 2.1 time: 0.156210 May 31 15:22:53.277901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1013/2011] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:53 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:54.294587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:22:54.295236 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:54.297169 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell0:SELECT=2 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:54.302854 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:54.303339 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:54.304118 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:54.304587 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:54.452140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:22:54.459988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cb22eaa2-fe01-4a1e-9369-6be27c20b952 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1507 microversion: 2.1 time: 0.169510 May 31 15:22:54.460561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 999/2012] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:22:54 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:22:54.476446 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5276e353-b555-44e5-8615-e933acf14714", "device": "/dev/sdb"}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:22:54.477547 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:22:54.479572 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=2 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:54.480225 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell0:SELECT=6 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:22:54.487075 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:54.487521 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:54.488290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:22:54.488727 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:22:54.734483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1fc7fd81-4305-42ad-8f9e-f7936796d610 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "POST /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261795 May 31 15:22:54.735137 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1014/2013] 10.222.0.67 () {60 vars in 1322 bytes} [Tue May 31 15:22:54 2022] POST /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:23:17.140561 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:17.141068 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:17.143440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=14 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:23:17.144205 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=30 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:23:17.150415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:17.150842 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:17.151603 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:17.152039 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:17.232290 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.objects.instance [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lazy-loading 'services' on Instance uuid dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 {{(pid=124107) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:23:17.303812 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-2cabc1d3-02e3-44bc-92e9-321233b62d49 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713/os-volume_attachments/5276e353-b555-44e5-8615-e933acf14714" status: 202 len: 0 microversion: 2.1 time: 0.167616 May 31 15:23:17.306312 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1000/2014] 10.222.0.67 () {58 vars in 1415 bytes} [Tue May 31 15:23:17 2022] DELETE /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713/os-volume_attachments/5276e353-b555-44e5-8615-e933acf14714 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:23:18.417484 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:23:18.418342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:23:18.422782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:18.423364 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:18.431535 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:18.431980 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:18.432766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:18.433200 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:18.460112 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Going to try to terminate instance {{(pid=124106) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:23:18.536863 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-ab21c377-0b3b-45c0-a722-b1acffcc2180 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 204 len: 0 microversion: 2.1 time: 0.120307 May 31 15:23:18.537684 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1015/2015] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:23:18 2022] DELETE /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:23:18.547837 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:18.548546 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:18.555283 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:18.555746 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:18.556520 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:18.556964 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:18.686430 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:23:18.693943 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d25940a3-bcbb-4b7c-85f4-91859fb294c8 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1513 microversion: 2.1 time: 0.150460 May 31 15:23:18.694512 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1001/2016] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:23:18 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:23:19.711476 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:19.712172 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:19.719260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:19.719710 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:19.720469 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:19.720907 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:20.064042 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:23:20.071674 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-eecde1af-8f3d-4e9a-9146-237dd045d9bb tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1513 microversion: 2.1 time: 0.364465 May 31 15:23:20.072248 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1016/2017] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:23:19 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:23:21.088022 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:21.088690 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:21.095182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:21.095687 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:21.096427 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:21.096902 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:21.375963 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-8be46603-8402-4c4c-8c80-88c0e7d96640 req-a9d6f966-9750-42c4-8960-a7b8a99a1450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6681e-ae8f-4a27-8e09-25e7f7f3c713", "name": "network-vif-deleted", "tag": "43914b89-2158-4614-a950-392c12c4f4ed"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:23:21.385294 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65894910ee8647f7b32395c0017d3562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dac67cb14e24c41b4add3b40a103fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:23:21.393260 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-8be46603-8402-4c4c-8c80-88c0e7d96640 req-a9d6f966-9750-42c4-8960-a7b8a99a1450 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:21.393396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-8be46603-8402-4c4c-8c80-88c0e7d96640 req-a9d6f966-9750-42c4-8960-a7b8a99a1450 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:21.393591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-cc4bcf5c-541f-4c17-b053-5eeaf21c1959 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 200 len: 1513 microversion: 2.1 time: 0.309008 May 31 15:23:21.394182 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1002/2018] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:23:21 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:23:21.407431 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-8be46603-8402-4c4c-8c80-88c0e7d96640 req-a9d6f966-9750-42c4-8960-a7b8a99a1450 service nova] Creating event network-vif-deleted:43914b89-2158-4614-a950-392c12c4f4ed for instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 on hv-cinder-83979 May 31 15:23:21.412356 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-8be46603-8402-4c4c-8c80-88c0e7d96640 req-a9d6f966-9750-42c4-8960-a7b8a99a1450 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040217 May 31 15:23:21.412959 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1017/2019] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:23:22.411369 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:23:22.411894 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] [instance: dbc6681e-ae8f-4a27-8e09-25e7f7f3c713] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:23:22.418368 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:22.419535 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:22.420308 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:23:22.420750 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:23:22.433860 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.wsgi [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] HTTP exception thrown: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Request method failure captured: May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: request: GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 HTTP/1.1 May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept: application/json May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Accept-Encoding: identity May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Connection: close May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Length: 0 May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Content-Type: application/json May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Host: 10.222.0.67 May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Openstack-System-Scope: None May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: User-Agent: python-urllib3/1.26.9 May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Auth-Token: gAAAAABiljJqv7wt12vfhy8sukQm0SrqUY4NFkLTA2KqiVYEThjpcmmZ64ewCTy4rueiplWxS7Jk5SulP3FIYtwdSJEmB6FYUokukgf6pg4P7qddakgjisW2PF4WP8-fED9n7qKvUD35GcUP8BSqUDKYCDFcd-DuH5L_3zyiNRZ3cMun1EDar4o May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Id: None May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Domain-Name: None May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Identity-Status: Confirmed May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Is-Admin-Project: True May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Id: default May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Domain-Name: Default May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Id: 2dac67cb14e24c41b4add3b40a103fea May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Project-Name: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Role: reader,member May 31 15:23:22.435526 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Roles: reader,member May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2dac67cb14e24c41b4add3b40a103fea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Id: 2dac67cb14e24c41b4add3b40a103fea May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-23317063 May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User: tempest-VolumesSnapshotTestJSON-23317063-project May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Id: default May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Domain-Name: Default May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Id: 65894910ee8647f7b32395c0017d3562 May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: X-User-Name: tempest-VolumesSnapshotTestJSON-23317063-project May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: method: > May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: exception: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. May 31 15:23:22.437011 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: action_args: {'id': 'dbc6681e-ae8f-4a27-8e09-25e7f7f3c713'} May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:23:22.437843 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. May 31 15:23:22.439077 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: ERROR nova.api.openstack.wsgi May 31 15:23:22.440085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] Returning 404 to user: Instance dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 could not be found. {{(pid=124107) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:23:22.440085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-b3c53cd0-66a4-4d79-bfcb-0752400cd753 tempest-VolumesSnapshotTestJSON-23317063 tempest-VolumesSnapshotTestJSON-23317063-project] 10.222.0.67 "GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713" status: 404 len: 111 microversion: 2.1 time: 0.029522 May 31 15:23:22.440085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1003/2020] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:23:22 2022] GET /compute/v2.1/servers/dbc6681e-ae8f-4a27-8e09-25e7f7f3c713 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:23:38.173317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:23:38.173865 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:23:38.345003 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:23:38.345485 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:24:08.871937 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:24:08.872773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:24:08.877336 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:24:08.877956 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:08.885839 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:08.886290 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:08.887087 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:08.887525 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:08.914324 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.objects.instance [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lazy-loading 'flavor' on Instance uuid 0ab93a71-e5e6-4b35-9c70-16d014051a7a {{(pid=124106) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 15:24:08.986696 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-baccce57-4baf-455b-92a5-e23e617a07f2 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "POST /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a/action" status: 202 len: 0 microversion: 2.1 time: 0.116139 May 31 15:24:08.987901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1018/2021] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 15:24:08 2022] POST /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:24:08.996466 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:08.997085 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:08.999331 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=8 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:24:08.999965 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:24:09.007716 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:09.008238 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:09.009333 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:09.010103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:09.151471 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:09.160087 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-4d7bea09-d87c-4a4b-a76b-6fbb1942f96c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.166999 May 31 15:24:09.160667 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1004/2022] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:08 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:10.178209 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:10.178940 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:10.185594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:10.186049 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:10.186857 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:10.187300 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:10.329124 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:10.337342 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-154ba6b3-5358-41f2-bfc9-a3ab14b2b5fe tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.163853 May 31 15:24:10.337920 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1019/2023] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:10 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:11.353972 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:11.354583 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:11.361311 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:11.361768 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:11.362517 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:11.363000 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:11.505911 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:11.513690 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-77b03285-c26d-4c9f-822e-133ad7a1abec tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.163554 May 31 15:24:11.514258 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1005/2024] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:11 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:24:12.531722 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:12.532383 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:12.539467 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:12.539922 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:12.540689 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:12.541129 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:12.692262 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:12.700483 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-2539c8f2-4dd2-4ce3-8471-74a7bf35d911 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.172994 May 31 15:24:12.701070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1020/2025] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:12 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:13.718792 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:13.719415 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:13.726548 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:13.727042 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:13.727808 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:13.728255 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:13.866569 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:13.874419 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-df267620-ece7-44ab-a970-d4a7bb5c0c7e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.159546 May 31 15:24:13.875030 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1006/2026] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:13 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:14.892197 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:14.892870 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:14.899576 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:14.900022 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:14.900782 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:14.901218 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:15.045737 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:15.054854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-1e57483b-2acd-4bd7-a722-6cc61b87d792 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.166949 May 31 15:24:15.055598 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1021/2027] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:14 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:24:16.072867 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:16.073490 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:16.080189 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:16.080649 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:16.081429 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:16.081896 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:16.215166 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:16.222833 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-9888c4f7-cbc5-42ac-93f7-d824f230d516 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.153880 May 31 15:24:16.223697 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1007/2028] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:16 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:17.241562 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:17.242123 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:17.249387 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:17.249836 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:17.250609 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:17.251071 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:17.436715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:17.445131 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-562d8179-6940-4326-8796-3e5dc5e0959e tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.208292 May 31 15:24:17.445730 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1022/2029] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:17 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:24:18.462052 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:18.462576 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:18.469048 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:18.469499 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:18.470261 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:18.470728 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:18.599809 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:18.607370 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-c818405d-93a2-4170-9a90-4d85d1788ad1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.149464 May 31 15:24:18.607945 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1008/2030] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:18 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:19.625140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:19.625766 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:19.632981 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:19.633438 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:19.634406 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:19.634724 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:20.095059 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:20.103773 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-bd4593dc-3049-4983-94d3-8fe77938bbd9 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.482511 May 31 15:24:20.104344 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1023/2031] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:19 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:21.122317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:21.122988 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:21.131029 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:21.131493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:21.132407 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:21.132703 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:21.269666 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:21.280217 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-eb463b1b-ab52-4469-ad47-d076b251acc3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.162562 May 31 15:24:21.280819 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1009/2032] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:21 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:22.298180 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:22.298841 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:22.306594 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.307078 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.308072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.308597 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.459103 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:22.466633 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-5dd617e0-7f6a-404b-af9f-fbe3ed17a3e3 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1571 microversion: 2.1 time: 0.172511 May 31 15:24:22.467216 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1024/2033] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:22 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:22.483219 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:24:22.483769 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:22.490453 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.490940 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.491718 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.492151 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.786817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-22afcd1e-3dd7-4a25-b861-fbfbc0a9b94c tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "POST /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a/action" status: 202 len: 0 microversion: 2.1 time: 0.307417 May 31 15:24:22.787440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1010/2034] 10.222.0.67 () {60 vars in 1277 bytes} [Tue May 31 15:24:22 2022] POST /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:24:22.796169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:22.796781 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:22.803468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.803910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.804703 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:22.805179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:22.955376 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:22.964164 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-a63baad3-80af-436a-a884-428677bf742a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1519 microversion: 2.1 time: 0.172107 May 31 15:24:22.964764 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1025/2035] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:22 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:23.981978 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:23.982602 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:23.988907 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:23.989363 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:23.990148 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:23.990591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:24.130679 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:24.138672 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-693c8125-265d-4af2-9ba2-f619a272c130 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1521 microversion: 2.1 time: 0.161226 May 31 15:24:24.139364 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1011/2036] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:23 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:25.159999 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:25.160644 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:25.169396 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:25.169845 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:25.170711 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:25.171181 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:25.322928 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:25.330976 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-4af7203d-a762-477d-a45f-f306c9a5a22d tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.176622 May 31 15:24:25.331590 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1026/2037] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:25 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:25.661103 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [req-16c7729c-97fc-4938-b37c-dd7327a32d42 req-2be83eb2-ed41-44a1-92fb-e9fc9664bcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "name": "network-vif-unplugged", "status": "completed", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:24:25.669804 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-16c7729c-97fc-4938-b37c-dd7327a32d42 req-2be83eb2-ed41-44a1-92fb-e9fc9664bcd1 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:25.670334 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [req-16c7729c-97fc-4938-b37c-dd7327a32d42 req-2be83eb2-ed41-44a1-92fb-e9fc9664bcd1 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:25.683230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.compute.server_external_events [req-16c7729c-97fc-4938-b37c-dd7327a32d42 req-2be83eb2-ed41-44a1-92fb-e9fc9664bcd1 service nova] Creating event network-vif-unplugged:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:24:25.688971 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [req-16c7729c-97fc-4938-b37c-dd7327a32d42 req-2be83eb2-ed41-44a1-92fb-e9fc9664bcd1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094243 May 31 15:24:25.689677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1012/2038] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:24:26.348363 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:26.349007 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:26.355557 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:26.356011 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:26.356826 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:26.357268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:26.484812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:26.492736 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8b4e2025-c9df-4b82-9dc5-390e4cdb47aa tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.148261 May 31 15:24:26.493299 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1027/2039] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:26 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:27.510385 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:27.511099 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:27.517257 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:27.517707 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:27.518462 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:27.518928 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:27.652066 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:27.660212 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-ff03f1b9-622f-4873-9351-2ce512a1d089 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.154487 May 31 15:24:27.660770 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1013/2040] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:27 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:28.677199 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:28.677812 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:28.684403 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:28.684858 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:28.685639 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:28.686080 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:28.825072 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:28.832793 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-c3ae831d-aa4e-4573-907d-c730d80beca0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.159937 May 31 15:24:28.833374 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1028/2041] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:28 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:29.849439 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:29.850007 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:29.856565 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:29.857013 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:29.857775 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:29.858208 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:29.989677 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:29.997265 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-d45f4c5d-5f6a-46a2-971a-b14db857117f tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.151767 May 31 15:24:29.997841 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1014/2042] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:29 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:31.015434 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:31.016070 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:31.024390 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:31.024854 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:31.025649 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:31.026093 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:31.166240 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:31.173715 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-8aa68e08-0dfa-4a47-8fad-f468c85d506a tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.162897 May 31 15:24:31.174281 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1029/2043] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:31 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:32.190958 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:32.191563 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:32.198227 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:32.198715 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:32.199492 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:32.199930 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:32.330773 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:32.338162 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-f114383f-438d-47be-83f0-0c34b355ab23 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.151300 May 31 15:24:32.338747 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1015/2044] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:32 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:33.356134 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:33.356743 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:33.363966 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:33.364409 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:33.365169 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:33.365596 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:33.513407 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:33.522398 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-43c130f4-9145-4abb-aab2-8478f89cd8b0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1577 microversion: 2.1 time: 0.170053 May 31 15:24:33.523249 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1030/2045] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:33 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:24:34.539508 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:24:34.540125 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:24:34.546946 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:34.547413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:34.548185 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:34.548634 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:34.681574 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:24:34.689050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-5e6ebd9d-2cc5-427e-b2d7-9dee46a97ffd tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1564 microversion: 2.1 time: 0.153416 May 31 15:24:34.689609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1016/2046] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:24:34 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 15:24:35.685312 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-609240a7-23ec-479e-8fae-21e939554769 req-8909cd04-df39-45f1-974e-31f59b7001f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "name": "network-vif-plugged", "status": "completed", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:24:35.698179 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-609240a7-23ec-479e-8fae-21e939554769 req-8909cd04-df39-45f1-974e-31f59b7001f0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:24:35.699367 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-609240a7-23ec-479e-8fae-21e939554769 req-8909cd04-df39-45f1-974e-31f59b7001f0 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:24:35.715985 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-609240a7-23ec-479e-8fae-21e939554769 req-8909cd04-df39-45f1-974e-31f59b7001f0 service nova] Creating event network-vif-plugged:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:24:35.721746 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-609240a7-23ec-479e-8fae-21e939554769 req-8909cd04-df39-45f1-974e-31f59b7001f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041640 May 31 15:24:35.722416 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1031/2047] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:25:25.527140 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:25:25.527732 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:25:26.572173 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:25:26.572759 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:25:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:26:11.824440 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_api:SELECT=28 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:26:11.825196 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG dbcounter [-] [124107] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:26:11.829559 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:11.830064 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:26:11.831806 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_api:SELECT=28 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:26:11.832910 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG dbcounter [-] [124106] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:26:11.840591 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:11.841050 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:11.842400 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:11.843171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:11.870901 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Going to try to terminate instance {{(pid=124107) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 15:26:11.900247 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-66688581-8c32-4a13-acc2-65b6fd0ed833 req-c67da499-a571-4c3f-807a-b78702c9d467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:26:11.910423 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-66688581-8c32-4a13-acc2-65b6fd0ed833 req-c67da499-a571-4c3f-807a-b78702c9d467 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:11.911160 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-66688581-8c32-4a13-acc2-65b6fd0ed833 req-c67da499-a571-4c3f-807a-b78702c9d467 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:11.922777 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-66688581-8c32-4a13-acc2-65b6fd0ed833 req-c67da499-a571-4c3f-807a-b78702c9d467 service nova] Creating event network-changed:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:26:11.928244 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-66688581-8c32-4a13-acc2-65b6fd0ed833 req-c67da499-a571-4c3f-807a-b78702c9d467 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102817 May 31 15:26:11.929020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1032/2048] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 15:26:11.957767 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-129fa46d-750d-4e5e-9485-0deb78076088 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 204 len: 0 microversion: 2.1 time: 0.134734 May 31 15:26:11.959244 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1017/2049] 10.222.0.67 () {58 vars in 1238 bytes} [Tue May 31 15:26:11 2022] DELETE /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 15:26:11.968333 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:11.969020 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:26:11.975239 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:11.975681 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:11.976471 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:11.976901 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:12.115238 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.policy [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124106) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:26:12.123397 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-6de7e078-f824-46fc-8f54-9b786821f4ab tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.159149 May 31 15:26:12.123974 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1033/2050] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:26:11 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:26:13.142098 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:13.142755 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:26:13.149774 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:13.150229 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:13.151034 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:13.151476 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:13.309609 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:26:13.317910 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-6c18e8b6-5c35-40c3-9a3c-ee6a98ef2af0 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1570 microversion: 2.1 time: 0.180166 May 31 15:26:13.318493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1018/2051] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:26:13 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:26:14.113630 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 31 15:26:14.117808 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [req-53a59629-490e-4d96-8699-24bbfd15e925 req-ff88b60d-0c27-4464-82c8-b5f184399c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93a71-e5e6-4b35-9c70-16d014051a7a", "name": "network-vif-deleted", "tag": "3c3544be-ecfc-48c1-901a-22955c0377b7"}]} {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 15:26:14.126776 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-53a59629-490e-4d96-8699-24bbfd15e925 req-ff88b60d-0c27-4464-82c8-b5f184399c65 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:14.127276 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [req-53a59629-490e-4d96-8699-24bbfd15e925 req-ff88b60d-0c27-4464-82c8-b5f184399c65 service nova] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:14.142136 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.compute.server_external_events [req-53a59629-490e-4d96-8699-24bbfd15e925 req-ff88b60d-0c27-4464-82c8-b5f184399c65 service nova] Creating event network-vif-deleted:3c3544be-ecfc-48c1-901a-22955c0377b7 for instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a on hv-cinder-83979 May 31 15:26:14.147461 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [req-53a59629-490e-4d96-8699-24bbfd15e925 req-ff88b60d-0c27-4464-82c8-b5f184399c65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035117 May 31 15:26:14.148140 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1034/2052] 10.222.0.67 () {64 vars in 1317 bytes} [Tue May 31 15:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 15:26:14.336647 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:14.337285 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.compute.api [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124107) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:26:14.344572 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:14.345047 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:14.345817 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:14.346472 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG oslo_concurrency.lockutils [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124107) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:14.415317 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.policy [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8c202f3b4a424cb6565fc8a6abd15b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24193a7426547f5895f8b8074e46875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124107) authorize /opt/stack/nova/nova/policy.py:199}} May 31 15:26:14.424413 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-23072e52-b212-4edb-ac94-d2ada39ef2c1 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 200 len: 1220 microversion: 2.1 time: 0.092183 May 31 15:26:14.425676 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1019/2053] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:26:14 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 15:26:15.441911 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '>' {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:15.442614 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.compute.api [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] [instance: 0ab93a71-e5e6-4b35-9c70-16d014051a7a] Fetching instance by UUID {{(pid=124106) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 15:26:15.452025 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:15.452468 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:15.453256 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 15:26:15.453690 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG oslo_concurrency.lockutils [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Lock "2401d9a6-6cbf-4ba3-af5f-9ceab2d8a36f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 15:26:15.459192 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] [5db2ee37-7c76-46fa-a7a4-df65e42e74a7] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 60928. May 31 15:26:15.468655 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.wsgi [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] HTTP exception thrown: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Request method failure captured: May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: request: GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a HTTP/1.1 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept: application/json May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Accept-Encoding: identity May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Connection: close May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Length: 0 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Content-Type: application/json May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Host: 10.222.0.67 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Openstack-System-Scope: None May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: User-Agent: python-urllib3/1.26.9 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Auth-Token: gAAAAABiljIQ2FAB0KbXJBayduwukGIH8z6tmesZ6ftYOV41ALOBZcvIs77PRZUGY0vvPC4M8fE4IJ-i0-DKIBbcxUnT3n5sTAfowZG1kzVljxrv50rmuQBB7u_kwgkVdZh90jc8ytHi6p5zSO1I5QU4bpXvPCoGMGHidISaazZRTWu7CMLmgig May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Id: None May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Domain-Name: None May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Identity-Status: Confirmed May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Is-Admin-Project: True May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Id: default May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Domain-Name: Default May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Id: e24193a7426547f5895f8b8074e46875 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Project-Name: tempest-TestShelveInstance-564415556 May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Role: reader,member May 31 15:26:15.470268 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Roles: reader,member May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e24193a7426547f5895f8b8074e46875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e24193a7426547f5895f8b8074e46875"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e24193a7426547f5895f8b8074e46875"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e24193a7426547f5895f8b8074e46875"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}] May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant: tempest-TestShelveInstance-564415556 May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Id: e24193a7426547f5895f8b8074e46875 May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-Tenant-Name: tempest-TestShelveInstance-564415556 May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User: tempest-TestShelveInstance-564415556-project May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Id: default May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Domain-Name: Default May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Id: 6a8c202f3b4a424cb6565fc8a6abd15b May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: X-User-Name: tempest-TestShelveInstance-564415556-project May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: method: > May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: exception: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. May 31 15:26:15.471631 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: action_args: {'id': '0ab93a71-e5e6-4b35-9c70-16d014051a7a'} May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: {{(pid=124106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 15:26:15.472402 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. May 31 15:26:15.473567 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: ERROR nova.api.openstack.wsgi May 31 15:26:15.474615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: DEBUG nova.api.openstack.wsgi [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Returning 404 to user: Instance 0ab93a71-e5e6-4b35-9c70-16d014051a7a could not be found. {{(pid=124106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 15:26:15.474615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO nova.api.openstack.requestlog [None req-e874c15f-05f0-4e51-8caf-24b96a8e0b44 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a" status: 404 len: 111 microversion: 2.1 time: 0.034003 May 31 15:26:15.474615 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: [pid: 124106|app: 0|req: 1035/2054] 10.222.0.67 () {58 vars in 1235 bytes} [Tue May 31 15:26:15 2022] GET /compute/v2.1/servers/0ab93a71-e5e6-4b35-9c70-16d014051a7a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 15:26:15.635584 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: DEBUG nova.api.openstack.wsgi [None req-41d074c9-922c-4c1e-a942-d7a73643b854 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] Calling method '.version_select at 0x7f8dbf7d2790>' {{(pid=124107) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 15:26:15.659580 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO nova.api.openstack.requestlog [None req-41d074c9-922c-4c1e-a942-d7a73643b854 tempest-TestShelveInstance-564415556 tempest-TestShelveInstance-564415556-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1926471896" status: 202 len: 0 microversion: 2.1 time: 0.027763 May 31 15:26:15.660230 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: [pid: 124107|app: 0|req: 1020/2055] 10.222.0.67 () {58 vars in 1253 bytes} [Tue May 31 15:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1926471896 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 15:26:58.181727 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:26:58.182359 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:26:58.352709 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:26:58.353182 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:28:45.535325 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:28:45.535966 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:28:46.580029 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:28:46.580636 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:28:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:29:02.713493 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:29:02.714171 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:29:27.297973 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:29:27.298537 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:29:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:30:18.190554 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:30:18.191154 dv-cinder-839793-14-iscsi devstack@n-api.service[124107]: Tue May 31 15:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 15:30:18.360437 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 15:30:18.360941 dv-cinder-839793-14-iscsi devstack@n-api.service[124106]: Tue May 31 15:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!